UNCLASSIFIED 


AD  NUMBER 


AD443912 


NEW  LIMITATION  CHANGE 
TO 

Approved  for  public  release,  distribution 
unlimited 


FROM 

Distribution  authorized  to  U.S.  Gov't, 
agencies  and  their  contractors; 
Administrative/Operational  Use;  1964. 
Other  requests  shall  be  referred  to  US 
Naval  Academy,  Annapolis,  MD . 


AUTHORITY 


USNA/Pitts  Univ  ltr,  15  Apr  1969 


THIS  PAGE  IS  UNCLASSIFIED 


i 


UNCLASSIFIED 

AO  4  4  3  9  1  2 


DEFENSE  DOCUMENTATION  CENTER 

FOR 

SCIENTIFIC  AND  TECHNICAL  INFORMATION 

CAMERON  STATION  ALEXANDRIA.  VIRGINIA 


UNCLASSIFIED 


NOTICE:  When  government  or  other  drawings,  speci¬ 
fications  or  other  data  are  used  for  any  purpose 
other  than  In  connection  with  a  definitely  related 
government  procurement  operation,  the  U.  S. 
Government  thereby  incurs  no  responsibility,  nor  any 
obligation  whatsoever;  and  the  fact  that  the  Govern¬ 
ment  may  have  formulated,  furnished,  or  in  any  way 
supplied  the  said  drawings,  specifications,  or  other 
data  Is  not  to  be  regarded  by  Implication  or  other¬ 
wise  as  in  any  manner  licensing  the  holder  or  any 
other  person  or  corporation,  or  conveying  any  rights 
or  permission  to  manufacture,  use  or  sell  any 
patented  invention  that  may  in  any  way  be  related 
thereto. 


4  4  3  9  1  2 


John  M.  Sedano 

Department  of  Industrial  Engineering 


DDC 


DDC  IRA  B 


Keyword- In-Context  (KWIC)  Indexing: 

Background ,  Statistical  Evaluation,  Pros  and  Cons,  and  Applications 

Major  Advisor:  Dr.  A.  0.  Holzman 

Encouraged  toy  among  other  things  the  "publish  or  periBh"  milieu 
of  today,  scientists,  educators  and  researchers  are  a  prolific  lot,  pub¬ 
lishing  technical  literature  in  explosive  proportions.  The  volume  is  such 
that  machines  have  been  called  on  to  aid  and  expedite  the  processing  and 
retrieval  of  Information. 

This  thesis  discusses  keyword-In-context  (KWIC)  indexing,  a  new 
metnod  of  machine  indexing  literature.  In  presenting  the  subject,  the 
author  assumes  that  the  reader  is  unfamiliar  with  the  new  discipline  of 
Information  Science,  precipitated  by  tne  information  explosion. 

The  background  of  machine  indexing  is  developed  deductively.  Next, 
the  author  describes  KWIC  indexing,  evaluates  statistically  the  hypothesis 
upon  which  it  is  based  (that  titles  are  descriptive  of  the  article  or 
document  they  represent!,  lists  its  pros,  cons  and  applications.  And 
finally,  the  author  concludes  that  KWIC  indexing  is  Indeed  an  efficacious 

• 


new  tool . 


/ 

KEYWORD- IN-CONTEXT  (KWIC)  INDEXING : 

BACKGROUND,  STATISTICAL  EVALUATION,  PROS  AND  CONS,  AND  APPLICATIONS 


f 

/ 

t>y 

John  Michael  Sedano  - 


B.a>,  U.S.  Naval  Academy,  1957 


% 


Submitted  to  the  Graduate  Faculty  of  the  Schools  of 
Engineering  and  Mines  In  partial  fulfillment  of 
the  requirements  for  the'  degree  of 
Master  of  Science 
in 

Industrial  Engineering 


Itelversliy  of  Pittsburgh 
1964 


ii 


FOREWORD 


Six  months  ago  the  author  was  first  introduced  to  a  keyword- in¬ 
context  (KWIC)  index.  That  the  KWIC  index  was  based  upon  the  titles  of 
documents  rather  than  document  contents  seemed  unusual,  that  it  was  pro¬ 
duced  by  a  computer,  not  a  human,  in  minutes  at  a  fractional  cost  seemed 
Incredible  and  that  there  were  individuals  who  doubted  and  even  belittled 
the  efficacy  of  this  wonderous  technique  seemed  perplexing.  As  time  passed 
the  author  became  more  intrigued  with  KWIC  indexing  and  finally  decided 
to  make  it  the  subject  of  this  his  Masters  thesis.  Format-wise,  the  back¬ 
ground  of  machine  indexing  in  general  is  developed  deductively.  Next  the 
author  describes  KWIC  indexing,  evaluates  the  hypothesis  upon  which  it  is 
based,  lists  its  pros,  cons  and  applications,  and  lastly  draws  conclusions. 
Furthermore,  this  complete  investigation  into  KWIC  indexing  is  basic  in 
approach;  it  is  written  for  the  reader  who  is  unfamiliar  with  the  newly 
emerged  discipline,  Information  Science. 
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I.  BACKGROUND 


A.  Information  Explosion 


The  importance  of  the  availability  of  information  to  the  scien¬ 
tific  community  has  long  been  recognized.  As  early  as  1852,  Joseph  Henry, 
secretary  of  the  Smithsonian  Institution  reported  to  Congress: 


"...It  is  estimated  that  about  twenty  thousand  volumes, 
including  pamphlets,  purporting  to  be  additions  to  the  sum 
of  human  knowledge,  are  published  annually;  and  unless  this 
mass  be  properly  arranged,  and  the  means  furnished  by  which 
its  contents  may  be  ascertained,  literature  and  science 
will  be  overwhelmed  by  their  own  unwieldy  bulk.  The  pile 
will  begin  to  totter  under  its  own  weight."  (l)* 


A  half-century  later,  Henry  Adams  wrote  of  the  law  of  acceleration  of  human 

knowledge,  that  if  it  were  "prolonged  one  generation  longer  it  would  require 

(2), (3) 

a  new  social  mind. . .subject  to  new  laws." 

World  War  II  precipitated  a  massive  increase  in  scientific  research 
and  a  concomitant  increase  in  scientific  literature  of  all  sorts.  Noting 
the  momentun  of  wartime  research  and  its  implications.  Dr.  Vannevar  Bush, 
the  great  American  scientist  prophetically  urged  his  colleagues  at  war's 
end  to  direct  their  efforts  toward  the  problem  of  sophisticating  the 
storage,  processing  and  retrieval  of  information.  In  hie  now  famous 
article  entitled  "As  We  May  Think"  he  stated: 


"...He  (man)  has  built  a  civilization  so  complex  that  he 
needs  to  mechanize  his  records  more  fully  if  he  is  to  push 
his  experiment  to  its  logical  conclusion  and  not  merely  be¬ 
come  bogged  down  part  way  there  by  over  taxing  his  limited 
memory.  His  excursions  may  be  more  enjoyable  if  he  can 
reacquire  the  privilege  of  forgetting  the  manifold  things 
he  does  not  need  to  have  immediately  at  hand,  with  some 
assurance  that  he  can  find  them  again  if  they  prove  im¬ 
portant."  (4) 

*  ftirenthetical  references  placed  superior  to  the  line  of  text  refer  to 
the  bibliography. 
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But  the  growth  of  scientific  output  has  continued  unabated  such  that  in 
more  recent  years  an  ever  increasing  chorus  of  voices  crossing  all  dis¬ 
ciplines  may  be  heard  expressing  alarm  at  the  accretion  rate  of  records  in 
fields  of  science.  Indeed  many  scholars  have  elaborated  the  theory  of  the 
exponent led.  growth  of  scientific  knowledge  and  literature,  ftie  following 
quotes  illustrate  the  existing  concern. 


"Die  world's  scientific  community  is  presently  generating 
a  flood  of  technical  literature,  and  much  of  it  is  not 
getting  into  the  hands  of  people  who  could  use  it."  (5) 

"As  the  mass  of  information  produced  by  scientists  and 
engineers  Increases  (at  rates  estimated  to  be  exponential), 
the  Inadequacies  of  available  methods  of  handling  infor¬ 
mation  are  revealed:  dissemination  is  delayed  because 
publication  media  are  backlogged:  retrieval  is  delayed 
because  the  time  needed  to  search  for  information  is  a 
function  of  the  amount  of  information  to  be  searched."  (6) 


Senator  Hubert  H.  Humphrey  in  a  televised  introduction  to  a  panel  dis¬ 
cussion  presented  in  connection  with  the  1962  Convention  of  Special 
Libraries  Association  stated  that  the  world  is  in  a  midst  of  a  "Revolu¬ 
tion  in  Information." 


"Ifae  ironic  fact  is  that  the  sheer  mass  of  information 
almost  defeats  our  efforts  to  find  what  we  are  looking 
for.  The  result  is  that  a  vast  amount  of  information  is 
unfortunately,  not  really  at  our  command.  It  may  be  known, 
but  inaccessible;  or  it  may  be  unknown  or  perhaps  lost  or 
forgotten."  (7) 


Francis  Bello  earlier  expressed  a  similar  sentiment  and  suggested  the 
obvious  means  for  wrestling  with  the  problem. 


"Mankind  is  learning  things  so  fast  that  its  a  problem 
how  to  store  information  so  it  can  be  found  when  needed. 
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Not  finding  it  costa  the  U.S.  over  $1  billion  a  year. 

Nov  machines  are  being  called  on  for  help."  (8) 

Currently  there  exists  no  quantitative  means  for  accurately  measuring  the 
output  of  technical  literature.  However  this  does  not  preclude  the  possi¬ 
bility  of  obtaining  some  partial  definition  of  it.  It  may  be  said  that 
there  are  now  somewhere  between  50,000  and  100,000  technical  Journals  being 
published  in  mdre  than  sixty  languages.  New  journals  keep  appearing  at 
the  rate  of  at  least  two  a  day.  This  year's  Journals  vlll  carry  between 

one  million  and  two  million  significant  technical  articles  with  a  yearly 

(9), (10) 

Increase  of  five  to  eight  per  cent.  And  what  is  more  astounding 

is  the  fact  that  the  world's  supply  of  recorded  knowledge  more  than  doubles 

(11) 

every  15  years.  To  this  must  be  added  an  increase  in  content  so  vast 
it  can  not  be  measured. 

In  view  of  the  foregoing  a  literature  crisis  might  be  defined  as: 
an  explosion  or  revolution  producing  at  a  geometrical  or  exponential  rate 
piles,  masses,  mountains  or  floods  of  information  to  bogg  down.  Inundate, 
bury  or  even  drown  poor  humanity.  Such  a  definition  is  exaggeratory 
only  to  the  extent  of  its  redundant  terms,  beyond  this  it  is  accurate. 

Even  the  famed  mathematician  and  philosopher,  Yeboshua  Bar-Hillel,  who 
rejects  the  urgency  and  the  existence  of  a  crisis  in  science,  recognizes 

(12) 

the  possible  crisis  in  the  fields  of  patents,  lav  and  library  acquisitions. 
Suffice  it  to  say  that  an  information  crisis  does  exist.  Beyond  the  ominous 
declarations  of  competent  scientists,  the  incontrovertible  fact  remains  that 
millions  of  dollars  are  being  spent  annually  by  the  National  Science  Found¬ 
ation,  the  three  military  services,  vlth  particular  emphasis  by  the  U.S. 

Air  Force,  the  Council  of  Library  Resources,  commercial  organizations  and 


a  handful  of  Interested  academicians  in  developing  systems  that  vill 


analyze,  store,  and.  on  demand,  accurately  retrieve  what  has  been  pub- 

(13),  (1*0 

lished. 


B.  Advent  of  Mechanized  Information  Retireval 

The  rapid  escalation  in  recorded  knowledge  has  had  the  following 
irreversible  effects  upon  man  as  a  user  of  Information. 

(A)  Limited  by  his  finite  capacity  for  absorption  and  retention, 
man  Is  forced  to  specialize. 

(B)  The  scope  of  his  specialty  is  shrinking  as  man  finds  it  In¬ 
creasingly  more  difficult  to  keep  informed  and  current. 

(C)  Man  desires  more  specific  and  detailed  responses  to  his 
information  needs. 

(d)  Attendant  to  the  foregoing  is  the  matter  of  timeliness.  Man 
wants  to  find  the  information  he  is  searching  for  more  rapidly. 

Man  is  not  alone,  repositories  of  recorded  knowledge  are  also  being  effected. 

(A)  Libraries  sample  and  offer  less  material  because  of  the 
enormity  of  recorded  knowledge. 

(B)  The  traditional  library  has  given  way  to  specialized  libraries 
and  specialized  information  centers  in  response  to  roan's  more  detailed 
searches . 

(c)  Libraries  and  specialized  information  centers  are  applying 
modern  machines  to  expedite  the  processing,  searching  and  delivery  of  in¬ 


formation. 
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In  essence  the  inordinate  size  of  recorded  knowledge  has  precipi¬ 
tated  a  new  discipline  .  Some  call  it  "librarianship" ,  others  call  it 
"documentation  science"  or  "information  Bcierice".  Whatever  the  label,  its 

reference  is  clear;  the  effective  management  of  man's  heritage  of  infor- 

(15) 

mation.  It  transcends  traditional  librarianship  by  featuring  the 

skills  combination  of  the  librarian,  the  documentalist,  the  publisher,  the 

writer,  t'M-  editor,  a-*l  very  importa.  b  the  r  dentist  and  enf  >neer.  That 

(16) 

puts  everyone  into  the  game.  Hie  interest  of  this  multidisciplinary 

corps  is  in  the  handling  of  specialized  knowledge.  Its  exponents  seek  to 
make  information  available  -  quickly,  conveniently,  accurately  -  to  the 
man  who  seeks  to  add  to  knowledge  or  to  draw  upon  it.  Hie  embodiment  of 
this  aspiration  logically  leads  to  an  information  storage  and  retrieval 
system.  And  for  clarity's  sake  the  definition  of  such  a  system  seems 
appropriate. 

"A  storage  and  retrieval  system  in  its  simplest  terms  is  an  organ¬ 
ized  method  for  putting  items  away  in  a  manner  which  permits  or  facilitates 
their  recall  or  retrieval  from  storage.  This  definition,  although  essentially 
circular,  is  intended  to  establish  that  a  storage  and  retrieval  system  must 

be  considered  as  a  single  system  and  not  as  a  storage  system  plus  a  re- 

(17) 

trieval  system."  In  other  words,  the  method  of  storage  determines 

to  a  considerable  extent  the  possibilities  of  retrieval.  Conversely,  the 
requirements  of  retrieval  establish  the  range  of  methods  of  storage.  Con¬ 
tinuing,  "mechanized"  information  retrieval  merely  implies  the  utilization 
of  machines  (from  the  simple  to  the  complex)  to  augment  a  storage  and  re¬ 
trieval  system. 
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Experience  In  mechanised  information  retrieval  indicates  that, 
in  general,  It  must  handle  these  types  of  material: 

(a)  large  files  or  collections  of  documents; 

(b)  complex  subject  matter,  usually  containing  many  subjects  of 
potential  interest; 

(o)  scattered  information,  usually  requiring  selection  from  among 

(18) 

many  documents  and  subsequent  correlation. 

Having  explained  that  mechanized  information  came  into  being  in 
order  to  ameliorate  the  conditions  precipitated  by  the  "Information 
Explosion"  and  having  stated  the  types  of  material  a  mechanized  informa¬ 
tion  retrieval  system  handles,  it  is  appropirate  to  discuss  the  component 
operations  of  such  a  system.  Further,  a  discussion  of  the  component  oper¬ 
ations  of  an  information  retrieval  system  continues  the  deductive  manner 
(first  stated  in  the  introduction)  in  which  this  thesis  is  being  developed. 
Parenthetically  this  "modus  operand!"  -  proceeding  from  a  general  back¬ 
ground  of  information  retrieval  to  the  specifics  of  machining  indexing  - 
was  chosen  on  the  assumption  that  a  complete  understanding  of  the  evalu¬ 
ation  of  machine  indexing  is  contingent  upon  the  reader's  having  a  clear 
idea  how  machine  indexing,  per  se,  fits  into  the  total  information  retrieval 
picture.  With  this  in  mind,  the  component  operations  or  unit  operations 
of  an  information  retrieval  system  follow  in  logical  sequence. 
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C.  Unit  Operations 

Any  information  retrieval  system,  whether  based  on  traditional 

library  methods  or  on  the  most  modern  machines,  involves  a  series  of 

steps  which  Allen  Kent,  Director  of  the  Knowledge  Availability  Systems 

Center  at  the  Uhiversity  of  Pittsburgh,  terms  "unit  operations."  They  are: 

acquisition,  analysis,  terminology  control,  recording  of  results  of  analysis, 

storage  of  source  documents,  question  analysis,  searching, and  delivery  of 

search  results.  Except  for  a  description  of  each,  only  the  second  unit 

operation  -  analysis  -  will  be  discussed  at  any  length. 

It  is  worth  noting  that  these  unit  operations  can  not  be  performed 

to  precise  specifications,  that  is,  it  is  difficult  to  delineate  precisely 

where  one  begins  and  the  other  ends.  Additionally,  some  may  be  performed 

simultaneously  or  at  different  times.  The  following  columnar  list  gives 

(19) 

Mr.  Kent' 6  unique  and  original  description  of  each. 


Unit  Operation 


1 .  Acquisition 


2.  Analysis 


a.  Abstracting 


Functions  Performed 


Locating,  selecting,  ordering 
and  receiving  of  source  documents 
for  a  collection. 

Perusual  of  source  documents  and 
selection  of  points  of  view  (or 
analytics)  that  are  coi  lered  to 
be  of  sufficient  probable  impor¬ 
tance  to  warrant  the  effort  of 
rendering  them  searchable  in  the 
system. 

Concentrating  the  essential  qualities 
of  a  larger  thing  -  a  summary  of  a 
publication  accompanied  by  an  adequate 
bibliographic  description,  to  enable 
the  publication  to  be  traced. 
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b.  Indexing  Selection  of  words  or  Ideas  from  a 

graphic  record  on  the  basis  of  well- 
defined  rules.  In  order  to  facilitate 
the  identification  or  selection  of 
desired  records  after  they  have  been 
stored. 

c.  Classifying  Arranging  or  placing  In  a  class 

on  the  basis  of  similarities  or 
differences. 

d.  Extracting  Selecting  for  quotation  portions 

or  source  material. 

3.  Terminology  Control  Establishing  arbitrary  relationships 

among  analytics,  e.g.,  based  on 
similarities  aaong  analytics  as 
revealed  in  dictionary  definitions . 

h.  Recording  of  Results  Use  of  card,  tape,  film  or  other 

of  Analysis  on  aedlua  on  which  the  analytics  are 

Searchable  Medium  transcribed. 

5-  Storage  of  Source  Physical  placement  of  record  in  soae 

Documents  location,  either  in  original  font, 

or  transcribed  or  copied  onto  a 
new  aedlua. 


Output 

1.  Question  Analysis  Expression  of  question  or  problems, 

and  Development  of  selection  of  analytics  in  terms  of 
Search  Strategy  a  particular  search  mechanism,  and 

arrangement  into  a  configuration 
that  represents  a  probable  link 
between  the  question  as  expressed 
and  the  records  on  file  as  analyzed. 

2.  Conducting  of  Manipulation  or  operation  of  the 

Search  search  mechanism  in  order  to  identify 

records  in  the  file. 

3>  Delivery  of  Results  Physical  removal  or  copying  of  record 
of  Search  from  file  in  order  to  provide  It 

in  response  to  question. 

As  may  be  readily  inferred  from  the  foregoing  list,  the  term 
"input"  Implies  the  processing  of  documents  into  the  system  by  system 


operator  personnel.  Contrariwise,  the  term  output  Implies  the  retrieval 


of  data  from  the  system  by  either  system  personnel  or  the  user.  Also, 
for  simplicity's  sake  Mr.  Kent  limits  the  results  of  analysis  to  abstracts, 
extracts,  classifications  and  indexes.  It  is  recognized  that  this  is 
not  an  exhaustive  grouping.  Results  of  analysis  among  other  things  in¬ 
cludes  annotations,  first  paragraphs,  last  paragraphs,  tables  of  con¬ 
tents,  etc. 


D.  Analysis 

Analysis  Is  the  most  time-consuming,  laborious,  ill -defined, 

complex,  and  undoubtedly  the  most  Important  Input  unit  operation.  Its 

complexity  stems  from  the  fact  that  It  Is  basically  predictive.  Naturally, 

because  the  analyst  -  digesting,  reducing  and  making  readily  searchable 

the  masses  of  documents  or  records  being  put  into  a  Bystem  -  is  essentially 

attempting  to  predict  the  desires  of  a  searcher  who  is  separated  from  him 

in  time  and  space.  In  effect  the  analyst  is  a  middleman  trying  to  serve 

two  masters:  the  author  by  accurately  representing  his  document,  and  the 

searcher  or  user  by  answering  his  Information  needs.  It  is  axiomatic 

that  no  analyst  can  predict  every  possible  point  of  view  or  use  that  could 

(20) 

be  demanded  of  any  document. 

Analysis  may  be  formally  defined  as  the  detailed  examination  of 
anything  complex  in  order  to  understand  its  nature  or  determine  its 
essential  features.  The  specific  purposes  of  this  unit  operation  are: 

(a)  to  provide  a  substitute  for  the  original  source  material  - 
abstract,  extract  or  annotation; 
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(I;)  to  permit  determination  as  to  whether  it  is  useful  to 

obtain  and  read  the  source  material  -  abstract,  extract  or  annotation; 

(c)  to  permit  identification  of  source  materials  that  are 

probably  of  interest  in  connection  with  one  or  another  quest  for  infor- 

(21) 

mation  -  index  entries  or  classification  subject  headings. 

These  purposes  establish  the  amount  of  detail,  or  depth  of  analysis 
as  well  as  the  form  in  which  the  result  is  provided,  i.e.,  abstract,  index, 
etc .  The  results  of  the  analysis  function  may  be  represented  graphically 
on  a  continuum  which  depicts  the  degree  of  processing  to  which  the  original 
document  is  processed.  See  Figure  1. 


Classification 
I  Indexing 


Extracting 


Abstracting 

_  Fact  Retrieval 


Minimum  _ 
Processing 


Maximum 

Processing 


Figure  1:  Degree  of  Document  Processing 

The  four  processes  which  comprise  the  analysis  function  are  similar 
in  certain  respects.  First,  each  of  the  processes,  namely,  abstracting, 
extracting,  indexing,  and  classifying,  could  be  performed  independently. 
Second,  all  involve  the  following  preliminary  steps: 
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(a)  reading  and  understanding  the  document  or  record  being 
processed; 

(b)  deciding  what  aspects  of  subject  content  are  important; 

(c)  selection  of  terminology  or  other  symbolisms  to  designate 

(22) 

the  Important  aspects  of  subject  content. 

As  shown  Ir  Figure  2,  these  three  basic  preliminary  operations  are  followed 
by  different  steps,  in  particular  the  composing  of  sentences  In  writing 
literary  style  abstracts,  the  copying  of  desired  sentences  from  the  source 
document  for  extracts,  the  establishment  of  index  entries  in  the  case  of 
indexes  and  the  assignment  of  class  designations  with  classification  systems. 

Third,  each  process  results  in  loss  of  Information  through  the 
elimination  of  certain  Individual  facts  and  the  corresponding  reduction  In 
amount  of  recorded  detail.  Depending  upon  policy,  the  relative  loss  of 
information  for  each  of  these  four  types  of  output  may  vary  within  wide 
limits.  For  example,  if  current  policy  emphasizes  research  and  development, 
scientific  information  will  undoubtedly  be  retained  in  great  detail  while 
other  information  or  facts  may  be  arbitrarily  lost.  As  a  general  rule,  the 
Information  loss  is  minimal  with  literary  style  abstracts,  particularly  when 
these  are  written  to  be  informative  in  character.  Next  in  loss  is  extracts 
which  lack  continuity  from  sentence  to  sentence.  The  greatest  loss  in  in¬ 
formation  occurs  in  assigning  class  designations  which,  as  a  rule,  do  little 
more  than  indicate  that  the  subject  contents  of  a  given  document  pertain  to 
one  or  more  generic  classification  subdivisions.  The  totality  of  Index 
entries  pertaining  to  the  contents  of  a  document  or  graphic  record  usually 
is  more  informative  than  a  classification  heading.  Additionally,  although 
Indexing  will  be  discussed  in  more  detail  subsequently,  it  is  worth  noting 
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Figure  2:  Preliminary  Steps  Common  to  Generating 
Abstracts,  Extracts,  Classifications 
and  Indexes 
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now  that  taken  separately  each  individual  index  entry,  as  encountered 
in  alphabetized  or  similarly  arranged  lists,  usually  pertains  to  a 

(23) 

single  narrow  feature  of  the  subject  contents  of  the  original  document. 

A  detailed  discussion  of  the  analysis  function  is  beyond  the 
scope  of  this  thesis.  Hie  preceding  remarks  concerning  analysis  are 
intended  to  provide  a  bridge  between  the  unit  operations  and  indexing. 


G .  Indexing 


The  importance  of  indexing  is  succinctly  expressed  by  authorita¬ 
tive  Calvin  Mooers  in  the  following  comment: 


"Hie  indexing  language  of  an  information  retrieval 
system  is  the  intellectual  mechanism  that  makes  the 
system  operate.  Next  to  the  actual  information  stored 
in  the  collection,  it  is  probably  the  most  important  part 
of  the  system.  The  indexing  language  is  the  means  of 
mediating  between  the  minds  of  the  customers  and  the  in¬ 
formation  stored  in  the  collection.  It  is  the  bridge,  the 
connection  between  the  users  and  the  information."  (2k) 


Moreover,  Allen  Kent  confirms  the  bridge  idea  and  expresses  the  myriad 
nature  of  indexing  methodology.  Here  is  Mr.  Kent  on  the  subject: 


"If  analysis  may  be  thought  of  as  the  cry  to  open  the  gates 
to  the  flood  of  human  imagination,  then  indexing  may  be 
considered  the  force  that  burst  the  dam  and  turned  the 
stream  of  information  handling  methods  into  an  uncon¬ 
strained  torrent.  It  is  almost  as  though  everyone  con¬ 
cerned  with  specialized  Information  activities  has  in¬ 
vented  an  indexing  method  of  bis  own,  and  there  seems  to 
be  more  enthusiasm  connected  with  this  unit  operation 
fragment  than  with  any  other."  (25) 


This  "bridge"  -  indexing  -  may  be  defined  as  the  selection  of  a 
set  of  terms  or  descriptors  from  an  available  vocabulary  to  describe  an 


item.  Putting  it  in  other  words,  the  process  of  indexing  involves  the 

selection  of  words  or  ideas  from  a  graphic  record  on  the  basis  of  well- 

defined  rules;  the  purpose  of  indexing  is  to  facilitate  the  identification 

(26) 

or  selection  of  desired  documents  after  they  have  been  sorted  and  stored. 

A  number  of  factors  must  be  taken  into  consideration  in  deter¬ 
mining  index  requirements  for  a  particular  collection  of  documents.  These 
include  the  value  of  information  contained  in  the  collection,  its  size 

and  use,  the  required  speed  and  completeness  of  retrieval,  and  last  but 

(27) 

not  least,  the  type  or  types  of  questions  asked  of  the  collection. 

The  type  of  index  is  directly  related  to  types  of  search  questions.  The 

following  table  illustrates  how  one  research  company  matches  index  require- 

(26) 

ments  with  types  of  search  questions. 


Types  of  Bequests 


is  of  Indexes 


Report,  by  code 


Collection  arranged  by  code 
no  index  required 


Report  by  author 


Author  index 


Report  by  title 


Index  to  titles,  shallow 
subject  index,  permuted 
title  index. 


General  background 
information 


Shallow  subject  index 


Information  in  document 


Specific  subject 
Generic  subject 


Alphabetic  subject  index 
Classified  index 


Coordinate  subject, 
i.e.  effect  of  part  of 
chemical  such  as  func¬ 
tional  group  on  its 
properties 


Coordinate  index 
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Essentially,  the  general  operations  In  indexing  and  searching  may 
he  reduced  to  this:  A  document  is  read  for  indexable  information;  con¬ 
cepts  are  selected  that  represent  important  aspects  of  this  document, 
aspects  that  vill  provide  future  handles  for  getting  at  the  document. 

Ibis  indexable  information  is  then  translated  into  standard  index  lan¬ 
guage.  In  searching  the  index  the  operation  is  reversed.  The  question 

is  first  translated  into  the  language  of  the  index.  Thereupon  the 

(29) 

desired  document  is  chosen.  This  description  is  elementary,  almost 

Infantile,  but  simple  as  the  operation  may  seem  it  is  not  without  serious 

complications.  These  complications  arise  because  indexing  is  predictive 

(30) 

and  represents  a  loss  in  information  as  stated  earlier.  Moreover, 
according  to  Frederick  Jonker  it  is  diffuseness,  not  Just  volume,  which 
compounds  the  indexing  and,  for  that  matter,  the  entire  information 
problem.  Dr.  Jonker  asserts: 


"Diffuseness  of  information  incites  that  items  of  infor¬ 
mation  may  be  of  Interest  in  a  great  many  problems,  uses, 
and  fields  of  pure  and  applied  science.  It  implies  that 
these  items  should  be  indexed  from  each  viewpoint  of 
potential  Importance.  The  diffuseness  of  an  item  of 
information  therefore  is  measured  by  the  number  of 
potential  indexing  viewpoints  or  criteria." 

"By  far  the  greatest  proportion  of  our  present  store 
of  knowledge  which  we  need  to  consult  constantly  and  rapidly 
is  of  a  highly  diffuse  nature.  This  high  degree  of  diffuse¬ 
ness  is  not  something  accidental.  It  is  inherent  in  the 
very  nature  of  our  technological  civilization,  in  the  fact 
that  every  achievement  or  finding  in  any  particular  field 
may  be  of  enormous  potential  Interest  in  almost  any  other 
field.  It  is  this  crossfertilization  which  is  responsible 
for  the  rapid  acceleration  of  progress,  which,  measured  by  the 
time  scale  of  history,  almost  assumes  the  proportions  of  an 
explosion.  Here  Indexing  theory  touches  the  mechanism  of 
progress."  (31) 


Studies  devoted  to  evaluating  the  capabilities  and  limitations 

of  subject  indexes  have  led  to  the  conclusion  that  they  are  inadequate  in 

the  form  in  which  they  have  been  previously  produced  to  respond  to  many 

information  requirements,  especially  those  whose  scope  may  specify  one  or 

more  generic  concepts.  These  inadequacies  in  subject  indexes,  mounting 

concern  at  the  time  and  cost  of  index  preparation,  plus  an  urgent  need  to 

increase  the  level  of  efficiency  in  scientific  research  and  development, 

have  provided  the  impetus  for  applying  and  developing  various  automatic 

and  semiautomatic  devices  to  accomplish  the  identification  of  documents, 

reports  and  other  technical  literature  that  are  of  keen  interest  to  a 

(32) 

given  R  and  D  problem.  The  net  result  is  that  in  the  past  20  years 

of  increasing  information  retrieval  research  many  breakthroughs  have  been 
achieved,  one  of  which  is  the  successful  application  of  machines  to  the 
indexing  syndrome. 

F .  Machine  Indexing 

1.  General 

Before  discussing  the  various  approaches  to  automatic  or  machine 
indexing  a  few  general  consents  seem  appropriate.  First,  one  of  the 
primary  objectives  of  research  in  machine  indexing  is  minimizing  the  human 
physical  and  intellectual  effort  at  the  "input"  end,  that  is,  in  processing 
documents  or  records  into  the  system.  The  aim  is  to  derive  the  appropriate 
index  entries  directly  from  the  unedited  text  of  a  document.  The  inter¬ 
mediate  human  efforts  of  creating  or  designating  index  entries  to  stand 
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for  a  document  in  storage  and  coding  tills  data  prior  to  feeding  it  into  a 
computer  are  eliminated. 

Second,  automatic  indexing  should  not  be  confused,  as  It  often  is 
in  the  literature,  with  mechanical  storage  or  with  mechanical  searching 
systems.  The  latter  merely  store  away  and  search  for  index  entries  that 
were  created  and  coded  by  human  effort.  Uhderotand,  of  course,  that  a 
machine  index  may  be  used  in  conjunction  with  mechanical  storage  and 
retrieval  systems. 

And  third,  the  automatic  processing  of  information  requires  that 

the  full  text  of  a  document  be  available  in  some  machine- readable  form 

such  as  punched  cards  or  paper  or  magnetic  tape.  Also,  the  earlier  in  the 

production  process  the  text  is  available  in  machinable  form,  the  greater 

(33) 

the  saving.  In  the  case  of  the  permuted  index,  which  will  be  discussed 

in  great  detail  subsequently,  thiB  aspect  is  not  significant  because  only 
the  bibliographic  data  pertaining  to  a  document  need  be  in  machine  readable 
form. 

2.  Approaches  to  Machine  Indexing 

There  are  three  basic  techniques  for  machine  indexing.  Ihey  are: 
the  statistical,  the  linguistic  (syntatic)  and  the  semantic. 

The  statistical  approach  utilizes  the  frequency  of  occurrence  of 
words  and  their  relative  distance  from  one  another  within  the  document  as 
the  rationale  for  determining  which  words  from  the  text  are  suitable  index 
entrLes. 

The  linguistic  approach  depends  upon  a  modern  linguistic  analysis 
of  the  language  structure  such  as  granener,  word  order  and  other  distinctive 
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forms  a  word  may  assume.  It  is  based  on  the  assumption  that  "the  ability 

of  the  machine  adequately  to  determine  information  relevance  depends  strongly 

on  its  ability  to  recognize  and  manipulate  the  syntactic  structure  of  the 
(310,(35), (36) 

text." 

The  semantic  approach  embraces  the  nature  of  meaning  of  words. 

Strictly  speaking,  words  have  "meaning"  only  as  they  are  used  in  particular 

statements.  They  can  be  studied  individually,  but  as  they  are  recorded  in 

a  dictionary,  which  offers  their  linguistic  data,  they  have  only  typical 

or  possible  meaning.  Which  sense  was  intended  is  usually  clear  from  the 

(37) 

sentence  in  which  it  is  used  -  that  i6,  from  the  "context" .  "Hie 

semantic  approach,  according  to  Climenson  and  his  colleagues,  evolved  from 

the  traditional  interest  in  semantic  classification,  descriptive  terms, 

(38), (39) 

cross-indexing  of  related  subject  fields,  etc." 

In  practice,  most  approaches  are  a  combination  of  the  three.  It 
may  help  to  think  of  these  techniques  as  a  continuum  of  structural  infor¬ 
mation,  see  Figure  3,  ranging  from  the  individual  word  as  a  complete  and 

(1*0) 

highly  structured  unit  on  the  one  hand  to  pure  meaning  on  the  other  hand. 


Figure  3:  Degree  of  Format  Structure 


To  date,  these  approaches  have  achieved  varying  degrees  of  success 


in  producing  machine-made  indexes  frets  textual  material.  More  sophisti¬ 
cated  techniques  for  automatic  selection  of  Indexable  matter  from  unedited 
text  and  automatic  processing  into  suitable  index  entries  are  currently 
being  developed. 

Still  there  is  another  approach  to  machine  Indexing,  one  which 
f-bviabei:  ?  >■  <■.  m, t-vlfc-.ea  ""  manlpuf  •- ting  ure-.iHed  te  t  since  it  deals 
exclusive >y  with  Vie  titles  of  documents .  There  are,  in  fact,  several 
methods  based  on  the  use  of  the  title  only.  Ihe  most  widely  used  of  these 
is  the  "Keyword- in -Context1'  or  KWIC  index.  It  is  this  mode  of  Indexing 
which  will  comprise  the  body  of  this  thesis. 

Before  discussing  KWIC  indexing  in  detail,  however,  a  glance  at 
Figure  It  will  graphically  reveal  bow  KWIC  indexing  fits  into  an  information 
retrieval  system  and,  no  less  important,  the  deductive  development  of  this 
thesis. 


System 


Analysis  Types  of  Types  of 
Unit  Operations  Suboperations  Indexes  Title  Indexes 


r 
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2- 
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Storage  / 

4 

Recording  Results 
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5- 

Storage 
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Delivery  of  Results 

Abstracting  /Author 
Classifying  /  Citation 
Indexing—/  Coordinate 
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\  Subject  \Shallow  subject 
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Figure  4:  Development  of  Thesis:  From 
the  General  to  the  Specific 


II.  KEW0RD-TM-C*j#TI?E3CI‘  (KWTC)  INDEX 


KWIC  is  a  machine-generated  printed  index  of  documents  which  usee 
as  index  entries  solely  the  keywords  in  the  document  titles,  A  KWIC  index 
is  frequently  referred  to  ae  a  permuted  title  index,  since  the  words  in 
the  title  to  a  document  are  rotated  or  permuted,  one  at  a  time.  Figure  5 
illustrates  how  the  title  "Statistical  Analysis  in  Advanced  Information 
Retrieval",  might  appear  in  a  KWIC  or  permuted  title  index. 


Keyword  Column 

Statistical  Analysis  in  Advanced  Information  Retrieval.# 

Statistical  Analysis  in  Advanced  Information  Re 
cal  Analysis  in  Advanced  Information  Retrieval.# 
in  Advanced  Information  Retrieval^# 

Statistical  Analysis  in  Advanced  In 


Figure  5:  KWIC  Index  Example  Using  a  Single  Title 


Note  that  all  words  in  the  title  with  the  exception  of  "in"  have  been 
rotated  under  the  keyword  column  and  that  each  indexing  word  or  keyword 
appears  in  alphabetical  order. 

Normally  this  title  would  appear  in  a  KWIC  index  five  times,  once 
for  each  keyword.  On  the  subject  of  keywords,  H.  P.  Luhn,  the  originator 
of  KWIC  indexing  has  this  to  say: 


"Keywords  need  only  be  defined  as  those  which  characterize  a 
subject  more  than  others.  Tc  derive  them,  simple  rules  have 
to  be  established  for  differentiating  between  what  is  signi¬ 
ficant  and  what  is  non-significant.  Since  significance  is 
difficult  to  predict,  it  is  more  practical  to  isolate  it 
by  rejecting  all  obviously  non- significant  or  "common" 
words,  with  the  risk  of  admitting  certain  words  of 
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questionable  status.  Such  words  may  subsequently  be 
eliminated  or  tolerated  as  so  much  "noi3e".  A  list 
of  non-significant  words  (called  a  stoplist)  would 
include  articles,  conjunctions,  prepositions,  auxiliary 
verbs,  certain  adjectives  and  words  such  as  "report", 
"analysis",  "theory",  and  the  like.  It  would  become  the 
task  of  an  editor  to  extend  this  list  as  required."  (kl) 


A  typical  stoplist  might  include,  but  certainly  not  be  restricted  to,  the 
following : 


a 

been 

if 

our 

these 

ago 

but 

in 

put 

those 

all 

by 

into 

Bee 

thru 

also 

do 

it 

she 

to 

an 

for 

me 

so 

too 

and 

from 

my 

seme 

upon 

any 

he 

of 

than 

we 

as 

her 

off 

the 

with 

at 

him 

on 

then 

yet 

be 

his 

or 

there 

you 

Ihe  phrase  "in-context"  suggests  that  bfter  the  keywords  are 
alphabetically  ordered,  they  appear  at  one  location  in  relation  to  the 
other  words  in  the  title.  Further,  the  resulting  index  listing  contains 
the  words  which  surround  the  keyword,  so  that  the  user  can  read  the  keyword 
in  its  context. 

Usually,  a  IWIC  index  consists  of  three  parts  or  sections:  Key¬ 
word  Index,  Bibliography  and  Author  Index.  Figures  7,  8  and  9  are  examples 
(*3) 

of  each.  In  Figure  7  note  that  the  keywords  have  been  arranged  alpha¬ 
betically  to  the  right  of  the  blank  column.  A  toted  of  60  characters  is 
printed  (this  may  vary  with  individual  preference),  2k  to  the  left  of  the 
keyword  and  35  to  the  right  of  it.  Because  the  space  allotted  to  titles 
in  a  KWIC  index  proper  is  fixed,  many  entries  will  show  only  part  of  a 


title.  A  technique  called  "wrap  around"  (also  called  recirculation  or 
snap-back)  is  employed  to  make  maximum  use  of  available  space.  For  com¬ 
parison,  observe  that  Figure  5  does  not  employ  wrap-around,  but  Figure  6 
does.  In  Figure  5  considerable  empty  space  may  appear  either  to  the  right 
or  left  of  an  entry  -  particularly  if  the  keyword  is  the  first  or  last 
word  in  the  title.  3feis  space  may  later  be  filled  with  more  of  the  con¬ 
text  of  the  keyword.  Just  how  many  other  words  can  be  shown  depends  upon 
the  length  of  the  particular  keyword  and  the  total  number  of  spaces  allotted 
to  the  title.  (Sixty  spaces  are  used  for  the  titles  shown  in  Figure  7; 
also,  note  the  use  of  wrap-around.) 

Keyword  Column 

r 

Statistical  Analysis  in  Advanced  Information  Retrieval.# 
trieval.#  Statistical  Analysis  in  Advanced  Information  Re 
cal  Analysis  in  Advanced  Information  Retrieval.#  StatlBtl 
in  Advanced  Information  Retrieval.#  Statistical  Analysis 
formation  Retrieval.#  Statistical  Analysis  in  Advanced  In 

Figure  6:  KWIC  Index  Using  "Wrap-Around" 

To  the  right  of  each  entry  in  the  KWIC  index  proper  appears  a 
reference  code.  This  directs  the  user  to  the  proper  bibliographical  entry, 
where  he  will  find  complete  information  regarding  the  title,  author  and 
source  (see  Figure  7) •  Thus  the  usual  KWIC  index  requires  a  double  look-up 
to  actually  find  or  order  a  document  -  once  in  the  KWIC  (or  author)  index 
and  once  in  the  bibliographic  index. 
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Figure  7:  Typical  Page  From  a  KVIC  Index  Proper 
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Figure  9:  KW TC  Author  Tndex  Page 


26 


A  typical  reference  code  is  shown  in  Figure  7-  It  consists  of  the  first  four 
letters  of  the  author's  last  name,  his  first  two  initials,  the  last  two 
digits  of  the  year  of  publication,  and  the  initial  letters  of  the  first 
three  words  of  the  title  of  his  document.  (Hie  following  words  are  dis¬ 
regarded:  the,  of,  in,  from,  by,  at,  as,  and,  an,  a,  on,  or,  to,  with, 
for.)  Hie  choice  of  the  composition  of  the  reference  code  is  practically 
unlimited,  however.  It  may  be  assigned  on  the  basis  of  report  numbers, 
patent  numbers,  some  arbitrary  numbering  system,  characteristics  of  the 
document  concerned,  or. even  on  the  order  in  which  the  bibliographical 

m 

entries  are  to  appear. 

Computer  manufacturers  offer  on  request  detailed  Instructions, 
programs  and  other  essential  data  necessary  for  producing  KWIC  indexes . 

MO  attempt  will  be  made  here  to  duplicate  their  effort.  The  intricate 
data  processing  techniques  inherent  in  the  preparation  of  KWIC  indexes  do 
not  conform  with  nor  advance  the  aims  of  this  thesis  which  are  rather  to 
subjectively  evaluate  this  mode  of  indexing  and  to  statistically  test  the 
hypothesis  upon  which  it  is  based.  Before  concluding  the  general  description 
of  KWIC  indexing,  however,  it  is  worth  noting  that  in  order  to  produce  a 
KWIC  index  of  titles,  bibliographical  entries  consisting  of  at  least,  title, 
author  and  source  are  recorded  in  machine- readable  form,  such  as  punched 
cards,  so  that  computer  processing  can  produce  the  printed  index  with  its 
bibliographical  data.  Hie  cards  making  up  the  master  record  bibliography, 
the  special  word  list,  and  the  KWIC  program  constitute  the  input  to  the 
computer  (see  Figure  10).  Upon  processing,  the  computer  determines  the 
status  (keyword  or  common)  of  each  word  in  a  document  title  by  looking  it 
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up  in  toe  stop  list.  All  ordering  and  arranging  of  the  Input  information 
Is  performed  by  the  computer.  A  magnetic  output  tape  containing  the  final 
arrangement  of  the  KVfIC  index,  the  bibliography  and  the  author  index  is 

(fc5) 

fed  through  a  printout  device  to  produce  copy  for  subsequent  reproduction. 


Figure  10:  Generation  of  KVTIC  Index 


Iir.  STUDY  OF  ADEQUACY  OF  TITLES  AS  SEARCH  TOOLS 


A .  General 

"If  the  (KWIC)  index  is  based  on  titles  of  documents,  its  quality 
depends  on  how  well  the  authors  have  composed  the  titles  of  their  papers", 
with  these  words  H.  P.  Luhn  almost  matter-of-factly  stated  the  hypothesis 
upon  which  KWIC  indexing  is  based.  Essentially,  the.,  the  efficacy 
this  mode  of  indexing  is  dependent  upon  whether  titles  are  in  fact  descrip¬ 
tive.  Ihose  who  assail  KWIC  indexing  claim  that  titles  are  not  descriptive, 
or  at  least  not  sufficiently  descriptive  to  merit  serious  consideration  as 
sources  of  index  entries;  its  exponents  claim  the  converse.  The  natural 
result  of  this  debate  has  been  several  studies  aimed  at  assessing  the 
adequacy  of  titles  as  search  tools. 

A  study  by  Montgomery  and  Swanson  showed  that  "the  present  in¬ 
dexing  of  medical  literature  as  published  in  Index  Medicus  is,  or  could  be, 
based  largely  on  examination  of  titles  and  word-plus -synonym  match  of 
titles  to  subject  headings."  Titles  were  found  to  be  about  50  per  cent 
effective  as  a  basis  for  judging  the  relevance  of  an  article  to  a  given 

(vr) 

information  need. 

Maizel.1  found  that  in  a  sample  of  25  articles,  included  both  in 

PhyBics  Abstracts  and  Chemical  Abstracts,  the  titles  alone  contained  about 

(ii8),(h9) 

50-70  per  cent  of  the  key  terras  under  which  the  articles  were  indexed. 

In  the  area  of  legal  literature,  Kraft  examined  3^28  titles  from 
legal  research  projects,  theses  and  the  Index  to  Legal  Periodicals.  His 
findings,  among  other  things,  revealed  that  6h.k  per  cent  of  the  title 
entries  contained  as  keywords  one  or  more  of  the  subject  heading  words 


under  which  they  were  indexed;  and  P-b-1  per  cent  contained  logical 
equivalents.  The  remaining  10. 5  per  cent  of  the  title  entries  had  non* 
descriptive  titles.  He  concluded  that  a  KWTl-  index  of  legal  titles  pro- 
duces  an  index  which  costs  less  than  a  subject  heading  system  in  both  time 

bo) 

and  cost  of  production  and  which  ranks  high  in  "f indabil i ty . *' 

It  seems  intuitive  to  this  author  that  highly  descriptive  titles 
will,  in  the  male,  be  found  in  the  technical  fields  of  science  and  er_- 
gineering  and  that  less  descriptive,  or  the  least  descriptive  titles,  will 
be  found  in  the  social  sciences  and  humanities.  As  stated  this  is  in* 
tuition,  and  regardless  of  Its  plausibility,  it  is  an  untested  premise. 

This  author  decided  to  test  the  premise  by  examining  titles  from  several 
fields,  principally  science  and  engineering,  and  ir.  so  doing  continue  the 
overall  research  effort  at  determining  the  adequacy  of  titles  as  search 
tool6.  In  this  regard,  Kraft’s  study  provided  a  worthy  guide  and  reasonable 
point  of  departure  -  his  procedure  was  modified  slightly  for  this  research. 
Six  published  indexes  to  periodical  literature  provided  the  source  of 
titles  for  the  study  and  the  findings  for  each  will,  be  discussed  in  detail 
after  the  following  description  of  the  procedure  employed. 

B.  Procedure 

The  scope  of  this  study  as  indicated  by  the  following  list, 
spans  the  subject  fields  of  science,  engineering,  social  science  and 

the  humanities . 
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Index 

Engineering  Index 

Applied  Science  and  Technology  Index 
ASM  Review  of  Metal  Literature 
Public  Affairs  Information  Science, 
Annual  Cumulated  Bulletin 
Business  Periodicals  Index 
International  Index 


Subject  Field 

Engineering  and  Science 
Engineering  and  Science 
Engineering  and  Science 

Economics  and  Informal! on 
Business 

Social  Science  and  Humanities 


In  each  instance  the  most  recent  annual  Jniex  was  chosen  on  the  assumptio: 
that  each  index  mirrors  the  most  current  periodical  literature  in  its 
respective  field. 

From  each  of  these  indexes  a  genuine  random  sample  was  taken. 
Randomness  was  achieved  using  numbers  taken  from  tables  of  random  numbers, 
initially.  Later,  to  expedite  the  process  of  locating  a  desired  title, 
random  numbers  were  computer  generated  within  limits,  the  limits  being 
the  total  number  of  pages  in  the  particular  index  and  the  maximum  number 
of  titles  per  page.  Randomness  was  maintained  in  order  that  statistical 
inferences  with  a  desired  level  of  precision  might  be  made  from  sample  data. 

In  this  respect  previous  studies  lacked  prevision  or  confidence  limits  because 
sampling  was  not  conducted  statistically. 

After  each  title  was  randomly  chosen,  keywords  were  selected  from 
it  by  the  author  using  the  rules  under  which  a  computer  would  have  operated. 
All  words  were  considered  keywords  with  the  exception  of  stoplist  articles, 
prepositions,  conjunctions  and  other  "common'1  words  (the  stoplist  was  pre¬ 
viously  discussed).  For  purposes  of  analysis  the  titles  were,  in  the  con¬ 
text  of  acceptance  sampling,  considered  as  either  effective  (KWIC-able)  or 
defective  (not  KWIC-able).  Beyond  this  major  dichotomous  classification, 
the  KWIC-able  titles  were  grouped  into  four  types.  For  a  graphic  illustration 
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of  the  logic  used  in  sorting  titles,  see  Figure  11.  The  examples  which 
follow  use  titles  from  the  Engineering  Index  (El) . 

TYPE  1:  A  title  which  contains  a  keyword  exactly  or  in  some  root 
forai  as  a  word  in  a  subject  heading  of  the  index. 

Examples: 

tl  Heading:  FUEL  CELLS 

Title:  "Fuel  Cells  and  Their  Effects  on  Utilities" 

El  Heading:  THERMODYNAMICS 

Title:  "Taxation'  Function  Makes  Entropy  Easier 

to  Undei stand" 

The  first  title  has  a  word  which  is  the  exact  same  as  the  subject  heading 
under  which  it  is  indexed.  The  second  title  has  a  word  "Entropy"  which  is 
a  subject  heading  in  the  Engineering  Index,  however,  "entropy"  has  a  "see" 
reference  to  "Thermodynamics".  In  either  case  the  title  contains  a  key¬ 
word  exactly  or  in  some  root  form  a6  a  word  in  a  subject  heading  of  the 
index . 

TYPE  2:  A  Type  1  title  which  could  have  been  indexed  equally  well 
under  another  subject  heading  which  appears  in  the  title. 

Example : 

El  Heading:  PYROMETRY  and  Offl  HEARTH  FURNACE 

Title:  .  "Immersion  Pyrometry  and  Open  Hearth 
Furnace  Productivity" 

Titles  of  this  type  are  even  more  "findable"  than  those  of  Type  1,  hence 
very  KWTC-able. 


Figure  11:  Logic  Followed  in  Sorting  Titles  by  Type 


TYPE  3:  A  title  not  classified  1  or  2  but  which  contains  a 
synonym  of  its  subject  heading: 

Examples : 

El  Heading:  PLUTONIUM  or  URANIUM 

Title:  "Simultaneously  Determining  Pu  and  U  in 

Dissolver  Samples" 

El  Heading:  AUTOMOBILE 

Title:  "Atonic  Age  Car  Concept" 

Ibis  classification  includes  few  titles  because  it  is  limited  to  abbre¬ 
viations  as  in  the  first  title  and  bona  fide  synonyms  as  in  the  second 
title . 

TYPE  1*:  A  title  not  of  Types  1,  2  or  3,  but  which  contain  key¬ 
words  that  would  enable  an  informed  researcher  to  find  it  in  an  obvious 
manner  under  a  KWIC  indexing  syBtem. 

Example: 

El  Heading:  HYDROCARBONS,  PROCESSING 

Title:  "Isomerization  or  Normal  Pentane  over  Platinum 

Alumina  Catalysts"  ~ 

El  Heading:  SPACE  VEHICLES,  COMMUNICATIONS  SYSTEMS 

Title:  "Transmission  of  Elec tromagnetic  Waves 

through  Ionized  Layer  in  Presence  of  Strong 
Magne  1 1  cTTcTTr  - 

As  Kraft  points  out,  titles  such  as  these,  illustrate  the  problem  inherent 
in  all  subject-  heading  systems:  Hew  can  the  searcher  "outguess"  the 


Ir-Jexe.-.  fr-tse  titles  would  be  lost  If  the  searcher  failed  to  think  of 

the  subject  headings  "Hydrocarbons,  Processing"  and  "Space  Vehicles, 

Communications  Systems"!  also  the  titles  were  not  indexed  under  any  other 

relate!  subject  headings.  A  KWIC  index,  however,  would  index  the  titles 

under  eacn  of  the  underlined  words,  some  of  which  are  very  descriptive, 

(51) 

making  them  a  cinch  to  find. 

TiTE  5:  A  title  not  of  Type.;  1,  2,  3  or  4.  This  is  the  class  of 
rnn-de K-ripttve  ("defective"  in  acceptance  sampling  context)  titles. 

Examples : 

El  Heading:  MOTOR  SHIPS 

Title:  "Nordvind" 

El  Heading:  PETROLEUM  HiOSPECTTHG,  OKLAHOMA  and  TEXAS 

Title:  "Major  Play  Shaping  Up  in  Palo  Duro" 

Admittedly  this  classification  scheme  is  subjective,  not  so  much 

in  separating  Types  1  and  2  titles  (this  is  simply  a  matter  of  determining 

the  presence  or  absence  of  a  subject  heading  for  each  keyword  in  the  title), 

but  certainly  in  sorting  titles  into  Types  4  and  5-  The  author  attempted 

to  be  unbiased,  if  indifferent,  in  the  sorting  process.  Whenever  there  was 

reasonable  doubt  about  how  to  classify  a  title  it  was  placed  in  that  group 

(52) 

which  was  least  advantageous  for  proving  a  case  for  KWTC  indexing. 

Wow  that  the  procedure  has  been  elucidated,  the  sampling  from  each 
index  will  be  discussed  in  turn. 
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C.  Engineering  Index  Sample 

1 .  General 

■The  Engineering  Index  is  published  annually  by  Engineering  Index, 
Inc.,  3^5  East  47th  Street,  New  York  17,  New  York,  which  "Indexes  and 
annotates,  selectively,  on  the  basis  of  engineering  significance,  the 
available  current  technical  periodicals  received  by  and  permanently  housed 
in  the  Engineering  Societies  Library.  Included  are  the  regular  pro¬ 
fessional  and  trade  Journals,  publications  of  engineering  societies,  scien¬ 
tific  and  technical  associations,  universities,  laboratories  and  research 
institutions,  government  departments  and  agencies,  and  industrial  organi¬ 
zations.  Papers  of  conferences  and  symposia,  separate  and  non-serial  pub¬ 
lications  of  various  kinds,  and  selected  books  are  also  covered.  Patents 
(53) 

are  excluded." 

The  particular  issue  chosen  was  1962;  it  includes  approximately 
31,000  brief  abstracts  of  articles  from  1000-odd  periodicals  and  serial 
publications  reviewed.  As  stated  previously  it  is  considered  by  the  author 
to  contain  a  representative  sampling  of  titles  from  the  fields  of  science 
and  engineering. 

■Rje  Engineering  Index  lists  each  title  only  once,  under  what  is 
presumed  to  be  the  most  appropriate  subject  heading,  but  makes  liberal  use 
of  the  "see"  and  "see  also"  reference. 

2.  Estimation  of  Sample  Size 

Before  the  statistical  sample  could  be  performed  on  this  index  it 
was  necessary  to  first  get  some  indication  of  the  required  size  of  the 


sample..  Xr.  probability  sampling  the  size  ct  the  sample  can  be  determined 
mathematically  once  the  desired  precision  and  estimated  variability  of 
the  result  Is  decided. 

With  respect  to  sampling  titles  from  the  index,  recall  that  the 
titles  are  sorted  into  two  broad  classes,  KWTC-able  and  not  KWTC-able. 

T'or  purposes  of  computation,  Q  represents  the  pro pc  id.  ion  of  KWTC-able 
titiee,  F  ."-presents  the  proportion  of  nob  KWTC-able  titles,  and  p  is  the 
estimated  proportion  of  P  from  the  sample.  lire  author  chose  a  margin  of 
error  i  in  the  estimated  proportion  p  of  titles  in  P  and  willingly  in¬ 
curred  the  small  risk  ct  that  the  actual  error  was  larger  than  d;  that  is, 

Pr  (  |p  -  p|id)  =  oC  (1) 

Again,  simple  random  sampling  was  assumed;  p  was  taken  as  normaly 
distributed.  Since  the  sample  (n)  is  very  small  In  proportion  to  the  total 
number  of  titles  in  the  index  (n),  the  standard  deviation  of  p  is. 


Hence  the  formula  that  connects  n  with  the  desired  degree  of  precision  is. 


where  t  is  the  abscissa  of  the  normal  curve  that  cuts  off  an  area  at 

the  tails.  Substituting  the  advance  estimate  p  for  P  and  solving  for  n, 

(5*0 

yields, 

«»  -U?-  *  v  « 

a* 

where  V  =—5  *  desired  variance  of  the  sample  proportion. 
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Next  the  author  set.  the  precision  requirements  consistent  with 

the  critical  result.  Parenthetically,  the  critical  result  in  any  study 

is  that  result  requiring  the  greatest  sample  size  to  achieve  the  desired 

(55),  (56) 

precision  in  view  of  the  estimated  variability.  Briefly,  the 

specification  of  precision  is  that  p  is  to  lie  in  the  range  (P±2.5), 
except  for  a  1  in  20  chance.  Kraft’s  work  is  used  as  a  basis  for 
an  advance  estimate  p  of  P.  Thus, 

dr  .025,  p=  .10,  at-. 05,  t=  I.96 

and 

n=  =  ^  550  (5) 

d  (-025)2 

It  is  worth  noting  at  this  point  that  550  is  an  estimate  of  sample 
consistent  with  desired  precision  and  advance  estimate,  p,  of  population 
proportion  defective,  P.  As  it  turned  out,  upon  sampling  from  the  En¬ 
gineering  Index ,  the  number  of  not  JWIC-able  titles  was  so  few  that  the 
advance  estimate  of  10#  defective  titles  proved  to  be  disproportionate,  hence 
all  sampling  was  terminated  after  390  titles  had  been  examined. 

3-  Classification 

The  results  of  the  sorting  of  titles  are  in  the  table  below: 


Type 

ii  2» 

U3II 

»4" 

Total 

Number 

}2k 

12lf 

8 

50 

8 

390 

i  of  Total 

31.8 

12.8 

2.05 

100.0 

*  Ihe  reader  should  recall  that  Type  1  titles  include  Type  2  titles. 
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4.  Confidence  Limits 


Since  n  p,  or  more  specifically  the  number  of  titles  observed  in 

the  smaller  (defective)  class,  is  small,  only  8  and  less  than  10$  of  sample 
(57) 

size,  Duncan  states  that  the  binomial  distribution  is  better  approxi¬ 
mated  by  the  Poisson  distribution  than  the  nomai  distribution  in  setting 
u;  confi4ev -e  for  P.  Confidence  limits  may  be  determined  for  this  case  f" 
a  variety  of  ways  such  as  the  Thorndike  Chart,  Molina's  Table  II  or  Dodgt 
and  Romlg's  ‘babies.  The  author  took  Cochran's  suggestion,  however,  and 
used  Table  VIII^  in  Fisher  and  Yates'  Statistical  Tables  (1957)  which 

"gives  binomial  confidence  limits  for  P  for  any  value  of  n,  said  is  a  useful 

(58) 

alternative  to  the  ordinary  binomial  tables."  Hie  applicable  portion 
of  Table  VIIIj  is  included  in  order  to  illustrate  the  calculation  of  the 
confidence  limits  for  P. 


a 

H 

Probability  P  of 
.005  .025 

'a'  or  more 
.1 

Probability  P  of  'a' 
.1  .025 

or  fewer 
.005 

8 

5 

3-04 

3.9^ 

5-09 

10.91 

12.06 

12.96 

.4 

2.92 

3.82 

4.98 

11.35 

12.79 

14.02 

•  3 

2.82 

3.72 

4.89 

11.77 

13.52 

15.10 

.2 

2.73 

3.62 

4.80 

12.18 

14.26 

16.22 

.1 

£.65 

3^53 

4.73 

12.59 

1^.01 

17-37 

0 

2-57 

4.66 

12.99 

Q| jS) 

I8.58 

<■ 

To 

obtain  the 

limits 

of  the  probability  of 

an  event  (observed  to  * 

occur  ’a'  times  out  of  fl)  corresponding  to  a  given  probability  level  P, 


divide  the  tabulated  values  by  N,  first  interpolating  if  necessary  by  linear 
interpolation  with  reference  to  P=a/N.  Hie  limits  of  the  expectation  of 
Poisson  distributions  are  given  directly,  taking  p*0. 
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The  limits  for  the  probability  of  8  defective  titles  occurring 
in  a  sample  of  size  390  may  be  gotten  from  the  table  directly.  Taking 
p=0,  the  limits  are  3-^5  and  15-76  as  circled  above.  Thus  the  95#  limits 
for  P  are  estimated  as: 


Pu  ~  v  100#  =  .885  per  cent 

ll  c  -vii 

Pu=  ~^q~  *  100#  —  4,04  per  cent 


Prom  which  it  may  be  said  that  there  is  a  very  good  chance,  a  95#  pro¬ 
bability  in  fact,  that  the  proportion  of  defective  or  not  KWIC-able  titles 
in  the  Engineering  Index  falls  within  the  interval  from  .885  to  4.04  per 

cent. 


Next  confidence  limits  were  determined  for  the  Type  1  titles  — 
those  titles  having  at  least  one  keyword  exactly  or  in  some  root  form  as 
a  subject  heading  in  the  Index.  Now,  however,  the  fraction  defective,  in 
this  instance  the  fraction  of  Type  1  titles,  is  larger  than  10#  such  that 
the  Poisson  distribution  and  the  very  convenient  Fisher  and  Yates  Table 
VTjlIi  no  longer  apply.  Duncan  points  out  that  in  this  case  the  binomial 
distribution  can  be  approximated  reasonably  well  by  a  normal  distribution 


with  a  mean  equal  to  p  and  a  standard  deviation  equal  to . 
Thus  the  95#  limits  for  Type  1  titles  are 


(59) 


83.1  ±  1.96 


/ (83.1) (16.9) 

V  390 


83.1*  3.72 


P_=  79.3 


F1  =  86.7 

u 


(6) 


This  simply  means  that  there  Is  a  9‘#  chance  that  the  proportion  of  titles 
in  the  Engineering  Index  having  at  least  one  keyword  exactly  or  in  some 
root  form  as  a  subject  heading  in  the  Index  will  fall  within  the  interval 
from  79 -i  to  86/7  per  cent. 

Comments  concerning  the  implications  of  this  sample  and  the  atten¬ 
dant  confidence  limits  ace  being  withheld  until  all  sample  data  is  pre¬ 
sented,  "'his  permit.,  a  graphical  compi lat-i  v.  and  a  comparison  of  results. 

In  Applied  Science  and  technology  Index  Sample 

1 .  general 

Applied  Science  and  Technology  Index  is  published  monthly  by 

H  W Wilson  Company,  990  Ufcdversity  Avenue,  New  York  52,  New  York.  Ibis 

publication  classified  engineering  and  science  articles  according  to  a 

subject  head!  rig  system,  including  hundreds  of  headings  6uch  as  Ablation, 

Aeration,  Iodides,  Magnetism,  Po'iarograph,  Transistors  and  Zwitterions. 

The  particular  issue  chosen  was  the  1962  annual  cumulated  index. 

The  Applied  Science  and  Technology  Index  indexes  engineering  and  science 

articles  from  some  215  publications.  Ibis  issue  contained  1313  pages  with 

55-60  titles  per  page  or  some  75, 000-oid  bibliographic  citations;  however, 

since  an  article  may  be  indexed  under  more  than  one  subject  heading,  it  is 

(60) 

not  known  how  many  distinct  titles  the  volume  includes. 

No  estimate  of  sample  size  was  confuted  for  sampling  this  index, 
the  experience  gained  in  sampling  from  the  Engineering  Index  led  the  author 
to  adopt  a  wait  and  see  attitude;  the  assumption  being  that  since  both  in¬ 
dexes  are  concerned  with  engineering  and  science  that  results  should  be 
similar,  campling  was  terminated  after  200  titles  had  been  examined. 


?.  Classification 


Type 

"2" 

"3" 

«V' 

"5" 

To  tax 

Number 

176 

135 

2 

15 

7 

200 

$  of  Total 

88 

67.5 

1.0 

7.5 

3.5 

100.0 

3*  Confidence  Limits 


Using  Fisher  and  Yates  again  the  95$  confidence  limits  for  P  are 
estimated  as : 


a  281 

K-  200 


i.k, 


A  lU2 

PU~  200  * 


7-2 


Also  the  95$  limits  for  Type  1  titles  are: 


Sb  *  1-*Jss$jr1  - 

Pt=  83.5,  Py  =  92.5 


(7) 


E.  Metal  Literature  Sample 


1.  General 

ASM  Review  of  Metal  Literature  is  published  monthly  by  the 

American  Society  for  Metals,  Metals  Rack,  Ohio.  It  is  "an  annotated 

survey  of  articles,  technical  papers  and  reports  appearing  in  engineering, 

(61) 

scientific  and  industrial  journals  and  books,  here  and  abroad."  This 


index  professes  to  index  based  on  the  content  of  the  article  and  not  merely 
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on  the  title.  To  accomplish  this  a  deeper  arid  more  le tailed  analysis  of 
subject  content  is  performed  and  more  flexible  cross-referencing  Is  em- 
pl oyed. 

The  particular  Issue  chosen  was  Vol .  19,  January-December  1962. 

Tfcfe  particular  issue  contained  approximately  13,800  indicative  abstracts 
from  900-odl  publications.  The  author  chose  to  sample  from  this  index  be¬ 
cause  it  embraced  a  far  more  specific  subarea,  metal  literature,  of  science 
and  engineering.  It  was  assumed  that  this  index  would  yield  even  better 
results,  that  is,  fewer  defective  titles. 

2.  Classification 


Type 

»2« 

lljll 

"4" 

It  yi 

Total 

Number 

103 

67 

0 

17 

0 

120 

$  of  Total 

86 

56 

0 

l4 

0 

100.0 

3.  Confidence  Limits 

Using  Fisher  and  Yates  again,  the  95$  confidence  limits  for  P  are 
estimated  as: 


x 

P 

u 


3-08 


And  the  95$  limits  for  Type  1  titles  are: 


i2i  ±  1.96 
120 


=  86*6.22 


Pl=  80.0, 


Pu=  92. 


(8) 
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F.  Public  Affairs  Information  Service  Sample 


1 .  General 

The  Public  Affairs  Information  Service,  Annual  Cumulated  Bulletin 
is  published  by  Public  Affairs  Information  Service,  Inc.,  11  West  40th 
Street,  New  York,  New  York,  10018.  "Its  purpose  is  the  publication  of  a 
weekly  Bulletin,  IS  .-.ting  by  subject  •urreirt  1  ooks,  pamphlets,  periodical 
articles,  government  documents,  and  any  other  useful  library  material  in 
the  field  of  economics  and  public  affairs,  The  Bulletin  is  not  primarily 
an  index  to  periodicals,  though  selected  articles  in  more  than  one  thousand 
periodicals  are  listed  each  year.  Publications  of  all  kinds  from  all 
English-speaking  countries  are  included,  as  well  as  many  printed  in  English 

I  in  other  countries.  Emphasis  is  placed  upon  factual  and  statistical  in- 

(62) 

formation.  Works  in  foreign  languages  are  not  mentioned. 

This  index  or  bulletin  was  chosen  by  the  author  as  a  first  step 
in  evaluating  titles  outside  of  the  fields  of  engineering  and  science. 

The  particular  issue  selected  was  Vol.  48,  October  1962-September  1963 
which  included  84^  pages  of  brief  annotations  with  approximately  33 ,000 
distinct  titles.  No  attempt  was  made  to  predetermine  a  sample  size;  it  was 
arbitrarily  set  by  the  author  at  300*  Farther,  because  of  the  extra  time 
involved  in  the  additional  look-up  required  of  Type  2  titles,  the  Type  ? 
classification  was  dropped.  Obviously  titles  which  would  have  appeared 
under  this  classification  still  appear  a3  Type  1  titles. 


2.  Classification 


Type 

ttgtt 

,,3,-, 

mam 

Total 

Number 

166 

- 

10 

113 

n 

300 

#  of  Total 

55.3 

- 

3.3 

37.7 

3.7 

100.0 

3*  Confidence  Limits 

Using  Fisher  and  Yates,  the  95#  confidence  limits  for  P  are: 


p  -  150  _ 

ru“  300  ” 


1.83, 


The  95#  limits  for  Type  1  titles  are: 


A 


P  - 


u 


.1965 

300 


6.55 


355  ±  1.96^111^111  *  55.3  ±  5.63  (9) 

PL=  ^9-7,  £u &  60.9 

G.  Business  Periodicals  Index 


1 .  General 

The  Business  Periodicals  Index  is  published  monthly  by  H.  W. 
Wilson  Company,  95O  University  Avenue,  New  York  52,  New  York.  This  pub¬ 
lication  indexes  118  periodicals  in  the  fields  of  accounting,  advertising 
bank  and  finance.  Insurance,  general  business,  labor,  marketing  public  ad 
ministration  and  taxation.  Its  citations  are  bibliographic  and  the  par¬ 
ticular  issue  chosen,  which  included  material  from  July  1962  through 


45 


(63) 

Jane  1963,  contained  approximately  49,000  entries.  It  is  not  known 

how  many  distinct  titles  the  volume  includes  because  articles  may  he  in¬ 
dexed  under  more  than  cue  subject  heading. 

As  with  the  previous  index,  the  author  arbitrarily  set  sample  size, 
in  this  case  at  510.  Also  the  Type  2  classification  was  dropped. 

2.  Classification 


Type 

Mgil  11*11  ll^ll 

11  ell 

Total 

Number 

229 

36  1 64 

79 

510 

$  of  Total 

45.0 

7.5  32.0 

15-5 

100.0 

3 .  Confidence  Limi ts 

Now  however  the  fraction  defective  is  larger  than  10$,  therefore 
the  normal  approximation  to  the  binomial  distribution  was  employed.  Thus 
the  95$  confidence  limits  for  P  are: 

15.5  ±  1.96 =  15.5  ±  3.15  (10) 

Pu=12.4,  Fu-  18.7 

The  95$  limits  for  Type  1  titles  are; 

§g  ±  1.96  = 45.0  ±  4.33  (n) 

PL  =.  40.7,  Pu=49.3 
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H.  International  Index  Sample 


1 .  General 

The  International  Index  is  published  quarterly  by  H.  W.  Wilson 
Company,  950  University  Avenue,  New  York  52,  New  fork.  It  is  a  guide  to 
periodical  literature  in  the  social  sciences  and  humanities  and  as  such  was 
the  most  generic  body  of  titles  which  the  author  examined. 

The  particular  issue  chosen  was  the  annual  cumulated  index  con¬ 
sisting  of  bibliographic  citations  of  articles  appearing  in  173  international 
period! cals  from  April  1962  through  Marc-b  19o3.  As  with  previous  Wilson 

volumes,  it  is  not  known  how  many  distinct  titles  are  included  because 

(6U) 

titles  may  be  indexed  under  more  than  one  subject  heading. 

Again  due  to  time  constraints,  the  author  set  sample  size  at  510  and 
dropped  the  Type  2  classification. 

2.  Classification 


Type 

"3" 

”4" 

t» 

Total 

Number 

16k 

a 

225 

113 

510 

<f>  of  Total 

32.2 

1-5 

Ik. 2 

22.1 

100.0 

Hie  94$  limits  for  Type  1  titles  are: 


$  ±  1.96 yikMfhSL  .  32.2  ±4.06  (l,) 

\  =  27.9,  pu=  :j6.i 

I.  Interpretation  of  Data 

The  results  of  the  preceding  six  samples  are  compiled  in  Table  I, 

page 

At  a  glance  it  is  obvious  that  titles  within  the  fields  of  en¬ 
gineering  and  science  are  very  effective  or  KWIC-able,  beyond  all  expecta¬ 
tion  as  far  as  the  author  is  concerned.  There  is,  in  fact,  a  95$  proba¬ 
bility  that  a  vast  percentage,  between  79-3  and  92.2  per  cent  (the  lover 
confidence  limit  of  the  Engineering  Index  and  the  upper  confidence  limit 
of  the  Applied  Science  and  Technology  Index),  of  the  titles  within  these 
fields  are  Type  1  titles. 

The  Applied  Science  and  Technology  Index  has  the  largest  percentage 
(83.5  to  92.5  per  cent  confidence  interval)  oi  Type  1  titles.  Hie  author 
feels  that  this  is  due  to  the  fact  that  titles  may  be  Indexed  under  more 
than  one  subject  heading  and  that  this  index  has  the  largest  number  of  sub¬ 
ject  headings  per  se.  The  author  offers  no  factual  evidence  to  verify  the 
latter  c eminent;  however,  the  fact  that  this  index  has  the  largest  number 
of  Type  2  and  smallest  number  of  Type  U  titles,  seems  to  substantiate  the 
observation. 

Hie  preponderance  of  Type  1  and  2  titles  might  suggest  that  indexers 
in  the  fields  of  engineering  and  science,  either  intentionally  or  unwittingly, 
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use  titles  as  a  basis  for  originating  subject  headings.  This  fact,  if  so, 
adds  substantial  support  for  KWIC  indexing,  because  KWIC  indexing,  in  con¬ 
trast  to  human  indexing,  can  be  done  by  machines  with  little  physical  and 
infinitesimal  intellectual  effort  being  required. 

That  the  ASM  Review  sample  yielded  no  defective  titles  came  as  no 
surprise  to  the  author.  It  was  apparent  while  conducting  the  sample  that 
this  index  bases  its  •  -  '<*1  the  content  of  the  article  and  not  merely 

on  the  title  -  something  which  was  not  apparent  in  the  other  samples.  Hie 
author  concluded  that  the  ASM  Review  indexes  metal  literature  throughly  and 
deeply.  Further,  it  and  the  Applied  Science  and  Technology  Index  actually 
had  more  Type  2  titles  than  Type  1. 

Comparison  or  contrast  of  the  width  of  the  confidence  intervals 
for  Type  1  titles  In  the  engineering  and  science  fields  yields  little 
because  the  sample  sizes  are  unequal.  In  this  instance  the  width  of  the 
intervals  is  not  related  to  proportion  of  Type  1  titles  but  to  sample  size. 

In  toe  engineering  and  science  area  toe  percentage  of  defective  titles 
was  least  in  toe  ASM  Review  sample,  increased  in  toe  Engineering  Index  sample 
and  increased  again  in  toe  Applied  Science  and  Technology  sample.  Hie  author 
feels  that  this  order  is  plausible,  if  predictable.  Assuming  identical 
analysis,  in  this  case  KWIC  indexing,  the  percentage  of  defective  or  not 
KWIC-able  titles  in  a  file  of  documents,  even  an  amorphous  file,  is  inversely 
proportional  to  the  degree  of  technicality  or,  better  stated,  the  technical 
character  of  the  documents  themselves. 

The  small  number  of  not  KWIC-able  tLtl.es  in  the  Public  Affairs  and 
Information  Service  sample  came  as  a  surprise  to  the  author,  for  it  imputes 
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a  technical  character  to  titles  of  documents  in  fields  (economics  and  public 
affairs)  which  are  unquestionably  vastly  less  technical  "in  the  usual,  sense" 
than  science  and  engineering.  "In  the  usual  sense"  deserves  discussion. 
Technical  in  the  usual  sense  has  come  to  delimit  the  use  of  the  word  tech* 
deal  to  science  and  in  particular  engineering.  This  is  erroneous;  technical 
may  apply  to  any  highly  specialised  field.  In  this  sense  medicine,  law, 
the  priesthood  as  well,  as  the  Navy  and  many  tiades  are  technical.  Fre¬ 
quently  such  fields  have  languages  or  lingos  which  the  non-cognoscenti 
find  confusing  or  unintelligible.  Jargon-filled  titles  from  such  fields, 
however,  are  exceedingly  specific  and  descriptive  for  the  profession  or 
trade-oriented  searcher.  It  is  in  this  context  that  titles  from  the  Public 
Affairs  and  Information  Service  Bulletin  rank  so  high  in  findability.  Its 
source  material  is  Indeed  technical  in  character,  much  of  it  being  the 
outputs  of  congressional  coranittees,  governmental  departments  and  other 
bureaucratic  agencies  which  characteristically  title  their  exudations  with 
balefully  scientific  and/or  onerously  long,  but  nonetheless  descriptive, 
titles . 

The  International  Index  sample  indicates  the  woeful  lack  of  des- 
scriptive  titles  in  the  social  sciences  and  humanities.  Here  authors  employ 
metaphor,  simile,  metonymy,  synecdoche  and  other  unpronounceable  artifices 
to  be  cleverly  non-descriptive.  For  example,  the  title, "Saints  and  Sinners 
in  Foreign  Investment",  which  appeared  under  the  subject  heading,  "Foreign 
Investment"  contains  metaphor,  but  remains  descriptive  and  KWTC-able.  Thus 
some  artful  languages  in  titles  Is  tolerable.  On  the  other  hand  titles 
such  as  "Milestone",  "Ike  Greeks  Had  a  Name  for  It",  and  "Squeezplay"  are 


hopelessly  non -KWIC -able  in  their  present  form .  Hie  author  is  not  suggest¬ 
ing  that  all  titles  he  descriptive.  On  the  contrary,  the  figurative  use 
of  words  in  non- technical,  and  transient  literature  is  refreshing  and  de¬ 
sirable.  Still.,  figurative  ploys  in  titling  are  the  bane  of  machine  in¬ 
dexing  as  this  sample  and  the  Business  Periodicals  Index  sample,  which  was 
little  better,  readily  illustrate. 

In  summary  this  study  reveals  that  a  XWTC  index,  based  on  keywords 
which  appear  in  the  title  alone  will  index  documents  in  the  fields  of  en¬ 
gineering  and  science  in  the  same  way  as  would  a  human  between  79  •  3  arid 
per  cent  of  the  time,  and  also  that  c>-6  largest  proportion  of  not 
KWIC-able  titles  sampled  was  a  mere  3«5  per  cent.  Further,  KWIC  indexing 
is  suitable  for  any  highly  specialized  field  (the  more  that  it  is  Jargon- 
filled  the  better),  not  just  engineering  and  science.  Clearly  the  adequacy 
of  titles  as  search  tools  in  any  highly  specialized  field  is  certain. 
Finally  the  less  specialized  the  field  (as  in  social  science  and  the  human¬ 
ities),  the  less  descriptive  titles  are  and  the  less  effective  KWIC  in¬ 
dexing  is. 


IV.  EROS  AND  CONS  OF  KWIC  INDEXING 


A .  General 

i/p  to  this  point  this  protracted  discourse  has  embraced  the  back¬ 
ground  oi'  KWIC  indexing,  a  description  of  it  and  a  complete  evaluation  of 
the  hypothesis  —  that  titles  are  adequate  search  tools  —  upon  which  it  is 
based.  However,  without  a  discussion  of  the  pros  and  cons  of  KWIC  indexing, 
previous  effort  ifl  singularly  incomplete.  Ibis  chapter  is  aimed  at  such 
a  discussion  and  advantages  shall  be  enumerated  first. 

B.  Advantages 

1.  Heretofore  this  thesis  has  discussed  KWIC  indexing  as  applied 
to  titles  of  documents.  It  may,  however,  be  carried  out  on  various  levels, 
depending  on  the  purpose  an  index  is  to  serve.  Hie  process  may  be  applied 
to  either  the  title,  abstract  or  entire  text  of  a  document. 

2.  Words  of  titles  are  ordered  in  their  original  sequence  so  that 
the  reader  has  little  difficulty  in  grasping  the  content  of  the  document 
which  the  words  describe.  In  printed  form  the  indexes  can  be  searched  rapidly 
by  eye,  so  that  the  need  for  machines  in  the  retrieval  phase  is  largely  ob¬ 
viated.  . 

j.  The  machine  will  index  a  document  many  other  ways,  the  exact 
number  of  entries  depending  on  the  number  of  keywords  in  the  title.  This 
redundancy  improves  the  probability  of  finding  desired  references,  since 
the  number  of  access  points  for  conducting  a  search  are  increased.  Certainly 
a  human  would  index  under  multiple  subject  headings.  It  is  doubtful  though 
that  he  would  use  as  many  entries  as  a  computer. 
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4.  One  of  the  major  advantages  of  KWIC  indexing  is  its  flexibility. 
If  the  title  does  not  adequately  describe  the  content  of  a  document,  des¬ 
criptive  words  may  be  editorially  added  to  improve  title  significance. 
Further,  such  words  can  be  made  to  act  as  keywords  under  which  the  title 
will  be  Indexed  or  they  may  function  as  stoplist  words,  which  appear  each 
time  a  title  is  indexed  but  which  themselves  do  not  become  index  entries. 
When  the  situation  arises,  editorial  revisions  may  be  made  either  to  prevent 
unwanted  terms  from  indexing  or  to  index  more  than  one  part  of  seme  words. 
For  example,  the  word  mucopolysaccarides  could  be  Indexed  under  muco,  poly 
and  saccarldes  in  order  to  give  researchers  more  than  one  approach  to  the 
subject.  Conversely  toe  hyphen  may  be  used  to  prevent  toe  indexing  of  cer¬ 
tain  words  contained  in  multiple -word  expressions.  For  example  very-high¬ 
speed  instead  of  very  high  speed.  The  references  "see"  and  "see  also"  are 
readily  exploitable  and  can  be  inserted  in  proper  alphabetic  positioning 

(65), (66) 

automatically  by  toe  computer  while  it  is  preparing  toe  KWIC  index. 

5.  The  acronym  "KWIC"  is  well  chosen  because  it  conveys  the  con¬ 
cept  of  speed.  It  is  not  extravagant  to  say  that  this  system  produces  in¬ 
dexes  more  rapidly  and  accurately  than  any  other  form  of  indexing.  Because 
of  the  speed  of  electronic  data  processing  equipment,  elapsed  time  between 

the  date  of  publication  of  a  document  and  its  appearance  in  an  index  can 

(67) 

be  reduced  from  many  months  to  a  few  days. 

6.  A  KWIC  index  system  has  toe  capacity  of  providing  the  users  a 
double  convenience  in  having  an  index  in  book  form  at  their  desks. 

7.  The  establishment  of  categories  and  toe  assignment  to  such 
categories  of  index  entries  is  a  matter  of  judgment  and  experience  and 
constitutes  a  considerable  part  of  the  intellectual  effort  involved  in  toe 
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manual  compilation  of  indexes.  These  and  a  vhole  h06t  of  indexing  decisions 
inherent  in  any  human  indexing  effort  are  eliminated  by  the  KWIC  index. 

Once  the  index  is  developed  and  in  production,  indexing  can  be  done  rapidly 
on  a  routine,  essentially  clerical,  basis  with  the  exception  of  adding  des¬ 
criptive  words. 

8.  Printouts  may  have  unlimited  formats  and  may  be  reproduced  for 

(68) 

■i  1  attribution  by  any  convenient  process,  such  as  photo-offset. 

9.  Generally,  a  KWIC  index  contains  three  sections  as  previously 

stated;  the  keyword  index,  a  bibliography  of  documents,  and  an  author  index. 

Other  sections  may  be  added  if  desired,  however.  For  example,  corporate 

(69) 

entries,  lists  of  periodicals  index,  etc. 

10.  KWIC  indexing  can  be  adopted  to  the  literature  of  any  scien¬ 
tific  discipline,  as  well  as  to  such  areas  as  correspondence  files,  files 
of  internally  generated  memorandums,  legal  papers,  procedure  manuals,  etc. 

11.  Costs  with  respect  to  the  preparation  of  a  KWIC  index  are 
very  encouraging.  Kraft  says  that  the  approximate  cost  of  producing  a 
KWIC  index  containing  2000  titles  on  rented  equipment  is  $580  per  month. 
Naturally  on  in-house  equipment  the  cost  would  drop  drastically.  Kraft 
makes  the  cammcb: 

"The  cost  per  article  indexed  is  only  29^.  This  compares 
most  strikingly  with  the  cost  of  manually  indexing  an 
article,  which  averages  $4.  ...Since  each  title  will  average 
six  keywords,  the  cost  per  index  entry  is  %  (2 9^/6)."  (TO) 

C.  K.  Bauer,  manager  of  the  Scientific  and  Technical  Information  Department 
of  the  Lookheed  Aircraft  Corporation,  Marietta,  Georgia,  claims  that 
Lockheed’s  newly  installed  KWIC  system  which  processes  150  new  books,  1250 
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reports  and  L2S  periodical;?  monthly  and  prepares  monthly  overdue  notices, 

accession  lists  and  financial  reports  saves  the  company  $600  per  month. 

Further,  total  run  time  in  data  processing  for  all  outputs  of  the  system 

is  less  than  two  and  one-half  hours  per  month,  including  taping,  sorting 

(71) 

and  printing.  Materials  from  Mr.  Bauer's  system  are  exhibited  in 

Appendix  A. 


C .  Di sadvantages 

1.  Hie  most  common  objection  to  KWIC  indexing  1b  that  titles  are 
not  descriptive  enough.  In  view  of  the  results  of  this  and  other  studies, 
the  author  does  not  feel  that  this  is  a  legitimate  objection.  KWIC  is 
feasible  in  highly  specialized  fields;  its  wholesale  use  is  not  suggested. 

On  the  other  hand,  when  a  title  is  found  to  be  non-descriptive,  or  not 
sufficiently  descriptive,  it  may  be  repaired  by  the  scant  editorial  effort 
of  adding  descriptors. 

2.  KWIC  Indexing  does  not  Index  deeply  enough.  Hiis  is  less  a 
disadvantage  than  a  limitation.  Certainly  KWIC’s  hands  are  tied  by  the  title 
when  it  canes  to  depth  of  indexing.  By  design  a  KWIC  Index  is  a  shallow 
Index,  and  consequently  it  can  not  hope  to  compete  with  the  likes  of  tne 

ASM  Review  of  Metal  Literature.  Each,  the  shallow  and  the  deep  index, 
serves  a  useful  purpose. 

3.  A  title  will  sometimes  have  adequate  keywords  but  still  cause 
confusion  because  it  is  not  descriptive.  For  example,  an  article  titled, 
"Fixed  Points  and  Antipodal  Points",  which  concerns  topology,  appeared  in 
the  American  Mathematical  Monthly  in  the  1963  issue  and  could  Just  as  easily 
have  appeared  in  the  Engineering  Index  or  the  Applied  Science  and  Technology 


Index.  If  this  title  were  to  appear  in  a  KWIC  index  comparable  to  either 
the  Engineering  Index  or  the  Applied  Science  and  Technology  Index  it  would 
cause  confusion.  The  title,  "Fixed  Points  and  Antipodal  Points",  could 
easily  he  assumed  by  radio  engineers  -  particularly  one  who  was  working 
in  the  currently  active  research  area  of  the  antipodal  reception  of  VLF 

(72) 

waves  -  to  belong  to  an  article  about  electromagnetic  wave  propagation. 
Another  title  that  could  be  confusing  is  "Ray  Baths  of  Whistling  Atmospherl cs 
Differential  Geometry:,  that  of  an  article  on  the  propagation  of  radio  waves. 
An  editor,  lacking  sufficient  subject-field  expertise,  would  undoubtedly 
KWIC  both  titles  and  thereby  generate  "noise"  in  the  system.  But  the  total 
elimination  of  noise  can  not  be  achieved  except  at  great  cost.  Hie  author 
feels  that  titles  such  as  these  appear  infrequently.  Hence,  the  noise  they 
generate  can  easily  be  lived  with,  at  least  until  interested  cognoscenti 
inform  the  editor. 

4.  Another  objection  to  KWIC  indexing  is  that  bibliographic  in¬ 
formation  must  be  in  machine  readable  form,  that  is,  must  be  punched  on 
IBM  cards.  This  of  course  is  a  drawback;  however,  the  time  and  manpower 
required  for,  and  the  cost  of  this  operation  is  low.  Keypunching  is  faster 
than  typing.  Also,  since  bibliographic  entries  are  in  machine  readable  form, 
they  may  be  used  for  other  purposes,  such  as  the  preparation  of  library 
catalog  cards,  accession  lists,  etc. 

5.  Two  objections  which  involve  the  format  of  the  KWIC  index  are 
that  it  is  not  very  readable  and  that  too  much  of  the  title  is  chopped  or 
lost.  These  objections  involve  programming  and  are  easily  remedied.  One 
technique  which  is  employed  by  the  American  Bar  Foundation  to  make  its 
Index  to  Current  State  Legislation  more  readable  is  shown  in  Figure  12. 
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PER  OP  PUMOSr  TO  CHANGE  ACCOUNTS  FOR  PROGRAMS  AND  REVISE  PRO  NU.U  COZOO-  X 

SIT  IN  PERSONAL  SAVINGS  -  IN  TRUST  CdS.  ANO  TO  INCLUU  HASS  Coi76-  / 

ISM  A  REPORT  OP  EXPENSE  -  Of  PURI  1C  SCHOOL  SUPIRINTEN  NlwM  ROOOl-H/ 

f REHRN TS  FOR  PRESENTING  -  TO  TMf  STATE  AUUlfUR  FOR  PA  NIB.  10749-  I 

IN  INDIVIDUAL  OR  JOINT  -  .-  amfnos  10.  Cm.  111.  IU  |N  MASS  C04I6-  I 

PON  RATING  AND  SOLVENCY  -  ,  ADD  PROVISIONS  AS  TO  REPAY  MICH  P02/6-AI 

ALLOW  UNLIMITED  SAVINGS  -  .  INCREASE  (INOING  ARIA.  PRE  MIS.  SOOJ4-  V 

P  THE  AUDITOR  OP  PUBLIC  -  .  SECRETARY  OF  STAIl  AND  STA  Nfft.  L0UB9-  / 

NO  TECHNOLOGY  TO  OBTAIN  ACCRIOI I Al ION  Of  IHC  ENGINEERING  CUR  Nt WH  ROOUt-f| 
ATE  NIGH  SCHOOL  GENERAL  ACHIEVEMENT  OR  PASSING  INlRANCE  EXAM  NO.D  COlFf-  I 
BA*.  FOR  CERTIFICATE  OP  AlKNOwLtDGMl  NT  OF  INSTRUMFNI  BY  PUBt  CAL.  COMBO-  I 
AOO  PROVISION  RE OUIAING  -  Of  SuCH.-  AMENDS  AND  NU.U  COtoJ-  I 

FlNSfS  aik»  10  PRESCRIBE  ACTUM  AMIR  DfClilUN  OR  VEKOICI  ON  CAL.  CIIOS-  * 

OHOBILf  REPAIRS  IN  TORT  -  FOR  DAMAGE  Id  MOTOR  VEHICLE.'  R.l.  COl/O-  / 

ROUNDS  FOR  DISCIPLINARY  -  INVOLVING  SCIIIEMENI  Of  UBLIG  CAL.  C099|-  I 

N  PROM  DC TERMINATION  OR  -  Of  THE  COMMISSION!  ft  ANO  RCVIE  NEW"  COJ04-U6 

DUKES  FOR  AND  EFFECT  OP  -  TAKEN  BY  DIRECTORS  BY  UNAN1NU  ILL.  HOftlS-  I 

NT  AGREEMENT  IN  DIVORCE  -  •  IO  DELETE  PROVISIONS  ALLOW  I  !Y  CAL.  CO»M-  1 

OP  CHILDREN  IN  OIVQRCI  -  •  10  PRESCRIBE:  AUIHORIIV  Uf  CO  CAL.  COBMl-  I 

PCCIPlfO  BONOS  IN  COUBT  AC  1 1  (NS  AS  PANIV  LIUGANTS  IN  THFIft  NE  S .  LOI/8-  1 

AUISKII  VENUE  IN  CIVIL  -  *Q*  PLAINTIFFS  UR  OLFINOANlS  CONN  PObOf-  I 

RECORDING  DISMISSALS  OP  -  ORDER! D  BY  THE  COURT.-  AMENO  CAL.  COB  IS-  % 

RENTS  ANO  LlN| TAf ION  OP  -  I  HE  NEON,  ABSTRACT  Pt ANT  REOU  Nl WM  C0JD7-  i 

I OL AT  IONS.  TO  PRESCRIBE  -  10  ftl  BROUGHT  Bl  f  ORE  POLICE  PA.  AO  IUB-  I 

LIMITATION  FOR  BRINGING  -  TO  ftfCOVtft  PAVMfNIS  MADE  UNO  NE  B.  LCBI 4-  I 

AS  TO  DAMAGES  IN  DEAIM  -  InCATEO  AS  NEW  ASSlTS.-  S«Rl  MASS  EOISG  I 

N  IN  CIVIL  ANO  CRIMINAL  -  .•  ADDS  |9.4,  AGRICUt I UR A l  CD  CAE.  C0916-  « 

Cf DURE#  BE  DISMISSAL  OP  -  .10  RfVlSE  AND  CLARIFY  PNUYI  CAl .  C08/4-  I 

OISABILITV  PAYMENTS  FOR  ACTIVE  I  AW  CNF ORCIMtNf  UFFICLRS  ANO  CAl.  C09/U-  » 

OF  PERSONNEL  COMPOSING  -  STATE  "ItlTIA  TO  INCiUOf  AIR  MASS  C0408-  I 

PAYMENT  BY  THE  CITY  OP  ACTUAL  COSTS  Of  8UAN0ING  CUT  PRISON  NIB.  10041-  / 

NANCE  ANO  DEFINITION  OP  ACTUARIAL  EUUlVAUNl.-  AMENDS  16-lb-  R.l.  C0O64-  / 
EN.  TO  INCLUDE  GUARDIAN  AD  l HIM  IN  LIST  Of  PERSONS  WHOSE  CU  R.l.  C0094-  / 
10  INCLUDE  ESTINATE  OP  -  VALOREM  TAX  RAIf.«  AMI  NDS  SA014.  CAl.  C114B-AI 
NEARING  STATE  CSTINATCO  -  VALOREM  I  AX  RAIL  FOR  PROPOSED  Of.  CAL.  CI5S8-H! 
O  PERSONS  EXEMPTED  PROM  -  VALOREM  TAX.-  AMENDS  /,  TITLE  SI.  ALA.  A04E9-  * 
PARTIAL  EXEMPTION  PROM  -  VALOREM  TAXES  ON  RlSIDENCt  01  TAX  •Oft!.  CO0D4-  I 
COMM If NEWT  AS  NARCOTIC  ADDICT  UNDF*  PENAL  1002.-  AMENDS  644  CAl.  Cl  104-  4 
NEW  POLICE  STAV  ION  AND  AOOHION  10  IIRL  H(  ADOUARTLftS.  -  AUT.l  R.l.  CGI'S-  t. 
LOW  HEIRS  TO  RECOVER  IN  -  TO  IfGAi  RL PR E St N T AT  I VES. -  CAL.  Cl  740-  7 

NOER  WHICH  TCSIANCNIART  AUDI 1I0NS  MAY  BE  DEVISED  ID  CIRTAlM  MASS  COmIB-  I 
DOLE  SC  X  CTV.  TO  PROVIDE  ApfUUAfE  FACILITHS  FOR  I  ME  UlSTRICI  HASS  CuSlv-  | 
ITEO  ACCESS  HIGHWAYS  TO  AD/AcFNT  COMMERCIAL  ANO  REST  FAC  It  IT  Nl  WM  ROOGB-A/ 
tO  PROCESS  SEWAGE  OF  AN  ADJOINING  ARIA  IN  ANOfHtli  STATE.-  AU  IdMA  S074/-  I 

FO  THOSE  EXTENDING  INTO  -  CfVS.  ANO  INCLUDE  MAJOR  I  ft  NEB.  1004S-  t 

PRINTED  AMQ  PROVIDE  FOR  ADJUDICATION  of  claims  by  DtPI.  OF  m  NIB.  100’IG-  / 
RE SCRIBE  PROCEDURES  POR  -  of  OdSLLNf  PUMIICAIION,  R.l.  cOOoB-  / 

DHRMT  TO  VOLUNTARY  PLAN  ADJUSTING  FUIURE  RINIFITS  FMOM  DISAft  CAL.  CI7I7-  i 
T  POR  PRIOR  SERVICE  ANO  ADJUST"!  wl  GF  RIII«l"FNT  ALL  UW  ANCE  •  *  CAL.  C/U/6-  I 

O  REVISE  PROVISIONS  POR  -  III  Sl/t  UF  PftlSUN  ENURPH  CAl  .  C09/V-  <* 

AL  MEMBERS  POR  BOARD  OP  -  .*  AMENDS  FBI ,  I  I  lit  it,  »  ALA.  A046 1- 

ALARY  POR  THE  ASSISTANT  ADJUlANI  GfNERAl  DESIGNATED  IXFCUUv  MISS  L0J‘I4-  / 
FHSOWlEl  IN  OFFICE  OF  -  Gl  NL  R  Al  Ul  IMF  STATE,  10  LI  CAL.  C14J0-  I 

TATE  INSTRUMENTALITY  TO  ADMINISTER  ACT  TU  PMOMOII  AND  OtVtlU  -I VA  HDJ44-  X 
A  BOARD  OF  GOVERNORS  TO  -  SUCH.-  ADOS  4A,  GH.  7S  TO  MASS  C04/9-  I 

ORITT  OF  SMALL  BUSINESS  ADMINISTRATION  ANO  REVISE  At  GUI  ATI  ON  Nt wH  C01/6-  4 

K.  CM.  T.  COMMISSION  OM  -  AND  FINANCE,  TO  KEVIS  MASS  C04  IV-  I 

•MISSION  TO,  PRDVIOf  FOR  -  AND  ENFiIRFFMINT  Mf  Hi  WH.  LOOS?-  V 

FOR  APVl SORf COMMITTEE .  -  AND  FINANCING.'  ME  PU  NEB.  lOluO-  f 

f  RECULAT  I  BnI  GOVERNING  -  AND  CUlttCIIDN  OF  TIM  NlwH  C0M6-  4 

CATE  THE  SfBIE  DEPT.  OP  -  I  Nt  O"  POR  All  NG  I  Ml  fUN  NEV.  Solid-  » 

/ONE  A  AMD  •  AREAS  FOR  -  UF  tICtNSED  PHEASANT  CAl.  Ci/Ul-  ft 

,  CM.  71,  LAWS  INI,  RE  “  OF  SCHOOL  ►  1  NANCE  ,  lU  NE  WM  cOJlU  AA 

SfONS  AS  TO  SOURCES  AMO  -  GF  FUNDS  AND  ACCOUNT  I  ft.l.  C007U-  i, 

VIDE  FOR  MANAGEMENT  ANO  -  «F  SUCH  PARA  BY  m|M,  «UM  .  GfSGU7  4 


I PLACES  AD.  CH.  lift  RE  -  Ut  WILLS  AND  FST4IES  MASS  COJ47-  I 

NEMOS  A7.13I  IDKHIt,  RE  -  «F  1 1  ft|  MC  NS  PENSION  I  WIS.  SOOIt-  I 

FEDERAL  SOCIAL  SECURITY  -  TD  U.S.  &CCRI I  AMY  Of  R.l.  C0O7Q-  6 

MORIZSS  COMMISSIONER  OP  -  TO  CONTRACT  ft  II H  I HE  MASS  C0447-  4 

F SCRIBES  PROCEDURES  FOR  -  ,  JUDICIAI  KCvllw,  INJ  ALA.  404«/-  7 

GOVERNOR.*  RC  FINANCIAL  -  ,  P"l SCRIBES  ft  F  DUG  1 1  ON  *UKL.  COD04-  t 

NOCPEMOCNT  AGENCIES  ANO  ADM INISTftATfVE  EXPENSES  (if  STATE  IMP  PA.  A0J44-  I 

CARDS  POR  EQUIPMENT  ANO  -  PR  AC  MCI  ANO  PRUVIOLS  OIL.  SO// 1-  X 

PROYAL .  DISAPPROVAL  AM)  -  KtVIlw.-  PRE SCR  IBIS  F  NIB.  104  7/-  / 

PROVIDES  FOR  REVIEM  OF  -  RULES  OF  ST  Alt  AGENCI  *0*1.  COODI-  / 

IOCS  FOR  APPOINTMCNI  OP  AC"I  NISTRA  TUR  FOR  COUNTY  LUMMI  SS  ION',  FLA.  COS  74-  4 
STATE  VETERINARIAN  ANO  -  OF  ANIMAL  HUSbANOMV  It.  R.l.  COO 74-  / 

PLACEMENT.  PROVIDES  FOR  -  ,  ftl IF  Nil  ON  OF  JURISOlL  MASS  C044/-  4 

PROVIDE  FOR  FIRING  ANO  ADMISSION  OF  BAIL  BY  JUDGES  UF  PHllA  PA.  A0147-  1 
RANCE  COS..  TO  REDEPINi  ApMIITlO  ASSETS  ANO  REGULATIONS  OF  I  III.  HOblft-  X 
CNI  OF  MINOR  PARENTS  TO  4  POP  II  UN  UF  CHILDREN,  Tl!  INCLUOt  GUA  R.l.  C00V4-  / 
fc  U»  RC  PILING  FOREIGN  -  RECORDS.  TU  CLARIFY  PROVISI  PA.  A0311-  * 

TO  PARfMTS  OF  PROPOSCO  -  ,  IU  PRESCRIBE  Mf  QUI  RC  "ENT  S  R.l.  COO  ■#/-  I 

OP  IMPRISONMENT  BEFORE  A OUL I  AUTHORITY  DETERMINES  l f  NG  T  H  Of  CAl.  CI7U/-AF 

MARI  DISCRETIONARY  WITH  -  AUTHORITY  DUTIES  UF  C*Sf -HE AR I  CAL.  CITO/-BF 

SCHOOL  POR  BOYS  AMO  THE  -  CORRECTIONAL  INSTITUTIONS.  TO  R.l.  COIM-  , 

SEPARATION  OP  MINOR  ANO  -  INMATLS.-  AMENDS  13-4-1/,  AUTN  R.l.  C0I71- 

IT10NS  IN  DEFINITION  OP  AOUL  Tf RA IE D  FOODS,  DELETE  PROVISION  MASS  C04B7-  4 
1-1-12  THRU  21-1-19.  RC  AOUl I F  RAT  I  ON  ANO  MISBRANDING  OF  FOOD  R.l.  CUI64-  4 
CQUISITION  OP  LOANS  AMO  ADVANCES  INSURED  OR  GUAKANHEO  ACCOM  MASS  CO  1/4-  I 
L.  TRADEMARK  OR  PORN  OP  AOVE KT I SEMENI . -  AMENOS  244.140,  HE  F  NtV.  S0092-  I 
R  REGULATION  OP  OUTDOOR  ADVERTISING  ALONG  THE  NATIONAL  SYSTt  R.l.  C0144-  t, 
REGULATIONS  TO  REQUIRE  -  ANO  ANNOUNCEMENT  AS  10  U  CAl.  Cl  349-AX 

P  NONCONFORMING  OUTDOOR  -  ANO  FINES  FOR  VIOLATION.  R.l.  COI44-  /. 

NCS  UNLAWFUL  HIRING  ANO  -  PRACTICES  FOR  OBTAINING  R.l.  CO/00-  / 

LIABILITY  POR  COST  POR  -  PUBLIC  HEARINGS  ANU  MAIL  MASS  COJbl-  / 

CE  10  PROVIDE  POR  LEGAL  AOVICC  ANO  DEFENSE  FROM  SfAfE  ATTORN  NO.D  COI 70-  / 
ENT  ANO  OP  THE  DEPT,  TO  AOVISC  TOWNS  IN  PLANNING  ROUTES  AND  MASS  COS  T9-  I 

IOC  FOR  EXPENSES  OP  TWf  ADVISOR  AND  fOR  INVITING  THL  U.S.  SE  NEB.  10074-Ax 

RIOR  EACH  TO  APPOINT  AN  -  .-  AMENOS  2-1403,  2-1404.  /- 1  Nil!.  iOO/4-Ax 

RS  CONTRACTS  ANO  CREATE  ADVISORY  BOARD  AND  APPEAIS  BOARD  THE  PA.  A0342-  ft 

RSHtP  ON  THE  PUBLIC  AIO  -  HOARD  FRU"  OPERATION  UF  SEC  Hi.  H0649-  I 

TER! AL.  PR OV IOCS  FOR  AN  -  BOARD,  PRESCRIBES  PROCIIMJRI  ALA.  A0482-  7 

UNC1L*  BEEP  COUNCIL  ANO  -  BOARDS  ASSISTING  IN  MAMftiTI  CAL.  CI6B6-  4 

ANI/ AT  ION  AMD  DUTIES  OP  -  COMNITTEI  UN  THE  TREATMENT  CAL »  CZGFft-Cl 

TE  AS  OCSIGMATEO  BY  THE  -  COMMITTEE.-  REPEALS  LXISIlH  CAL.  llftll-  X 

ERSH1P  AND  DUTIES  OP  AN  -  COMHITTl.  TO  Idt  STATE  Sflll  NIB.  L0U9I-  I 

CASES  ano  provides  FOR  -  committee,  ADMlNISTRAIION  a  NEB.  LOIOu-  f. 

AL  UNIVERSITY  EXTENSION  -  COUNCILS  FUR  NECESSARY  ExPf  MASS  C0406-  I 

ANO  POWERS  OF  REGIONAL  -  PLANNING  COMMISSION.-  AUTHu  ALA.  AO404-  4 

N  BY  INC  STATE  DEPT.  OP  AERUNAUIICS  AS  10  AIRCRAFT  AWARDED  C  Ul.  MUOBl-  I 

44-1-14  CREATING  STATE  -  COMMISSION  ANO  DEFINING  NEW*  COM4-  * 

ENSATION  POR  MEMBERS  OP  -  COMMISSION.-  STRIKES  AND  NtWH  C0JI7-  i 

ROPERTV  OP  THE  DEPT.  OP  -  AUTHORIZES  ANO  PRESCMI  NEB.  t 0BU6-  | 

SCRIBE  REOU  I REMENTS  POR  AERUSUl-IVPC  CONTAINtRS  AND  10  IXTf.N  CAL.  CU9BO-  » 
ES  DIRECTOR  OP  VETERANS  AFFAIRS  10  COMPIEIE  ACQUISITION  OF  I  #ORI .  CD007-  4 

SI0N4L  ANO  OCCUPATIONAL  -  TO  RESTRAIN  UR  PREVIN!  UNAUI  PA.  40 t »»-  3 

TIOHS.  REQUIREMENTS  FOR  AFFIDAVIT  OF  COMPLIANCE.  EXCEPTIONS  Nl WM  C0IU7  1 

0  REENACTS  16-12-14.  RE  -  RlQUKUD  Uf  CHALMNGEO  VOI  NO.D  LOlftT-  I 

ft  APPOINTMENT  ANO  PARTY  AFFILIATION  OF  APPOINTElS  OF  JUDGE  R  AO.U  COIOI- 
LI  Ml  TAT  IONS  AS  TO  THOSE  AFfllClEO  WITH  CEHCHMAl  PALSY  IN  ClF  PA.  AOUft  4 
4-Oi,  PROHIBITING  GOING  AFIELD  WITH  SHOTGUN  FROM  JULY  1ST  TO  NU.U  C0IV4-  I 
NO  TUWNS  FURNISHING  OLD  AGE  AIO  AND  10  OCIETE  PROVISION  AS'  I  MASS  COSbb-  i 

NANCE  UNDER  LAW  POR  OLO  -  AIO.-  AMENOS  I.  CM.  1IVA,  TU  INC  MASS  CD44U-  I 

G  VARIOUS  FUNOS  FOR  OLD  -  AID,  MCNIAl  HI AL I H,  SCHULARSHIP  ALA.  A0SB9-  / 

M  EMPLOYMENT  BECAUSE  OP  -  ANO  PRESCRIBES  PENALTY  FOR  VIOLA  Nlh.  L07/4-  I 

PAYMENT.  ETC*"  RE  SPACE  -  INDUSTRIAI  PARR,  CONFIRMS  AUlHOx  «URf.  CUOO/-  4 

10  INCREASE  THE  MAXIMUM  -  Of  ELECTION  JUOGI  S  ANU  CLERKS  IN  NIB.  100*4-  I 

F  TAXPAYERS  6»  YEARS  OP  -  UR  ULOFR.  TO  CLARIFY  Oil  INI T IONS  »aftl  .  C0004-  I 

FOR  EDUCATION  OP  SCHOOL  -  PAT  IF  NTS  IN  CHtlORfNS  MEMORIAL  M  UKLA  S004R-  » 

NS  GOVERNING  RETIREMENT  -  UNDER  STATE  EMPLOYEES  RtllRtMCNl  NF WH  10*12-  ♦ 

PERSONS  OVER  A  CERTAIN  -  ,  ENTERING  PUBLIC  EMPLOYEES  RE  1 1 w  MASS  C049R-  I 

ES  FOR  NURSING.  FOR  THE  AGED  ANO  THE  INFIRM.  TO  RLYISC  TAXlN  INI).  C07/2-  / 
ESSMEMTS  OF  INDEPENDENT  AGENCIES  AND  ADMINISTRATIVE  (XPINSES  PA.  40144-  I 
EUR  USE  BY  OTHER  PUBLIC  -  4 NO  DIRECTS  DISPOSITION  UF  CAL.  CI442-  I 

E  REGULATIONS  POR  STATE  -  AND  LOCAL  PUBLIC  IN!  IMIS  I  C*L  .  C 148/-  X 

INCORPORATED  INSURANCE  -  ANO  PAYMINI  CF  MINIMAL  UR  U  FI  A.  COIBl-  / 

MPT  I  IMS  OP  GOVERNMENTAL  -  ANO  SPICIMED  SHIPMENTS.-  4  ILL.  HU64U '  4 

STRAY  I VE  RULES  OF  STATE  -  NY  I  ME  ItGISlAHVl  Cl  ION  SI  L  »UR*  .  COOUi-  / 

UCTIOK  BY  VARIOUS  STATE  -  DURING  IHt  BIENNIUM  AND  Of  Ml" l •  C00U4-  I 

1  ES,  ETC.,  U.S.  ANO  ITS  -  IN  THE  cUNIRfll  AND  PREVIN!  I  M  ft.  10D/I-A7 

OTHER  SPECIFIED  PUBLIC  -  TO  ACT  JUINILV.-  ADOPTS  INI  NIB.  10647-  4 

NS  TO  TOURIST  PROMOTION  -  .-  ADDS  |9ftb.  At f  «•  AUG.  9,  PA.  A0»48-  . 

S  WITH  STATE  OR  FEDERAL  -  .  PRUMIBI  T  L  •.  T  A  ftl  I  Sl«"l  Nl  (IF  CAl.  CJ43I-  4 

TES  LEGISLATIVE  SERVICE  AGENCY  COMMIT  l|!  ANU  OEFINIS  US  PUw  PA.  AO  »60-  I 
LITICAL  SUIDIV. ,  PUBLIC  -  UR  INTITV  AS  In  CtAIftS  AuAINS  CAl.  C|b8l-  v 

BY  PUBLIC  CORPORATION,  -  UR  PlIllTICAL  SUBOIV.  Of  SlATt  CAL.  COflftO-  1 

HE  PA.  HIGHER  EDUCATION  -  IO  |NPR(JVI  OPPURTUNIMIS  AND  PA.  A0/90-  t 

STATE  RAOIAMON  CONTROL  -  10  UClNSt,  INSPICI  AND  RlGUI  ALA.  Af46/-  t 

Ht  U.S.  AMO  ANY  FEDERAL  -  ADOS  AftT.  14,  CH.  SI,  ENACT  WCVA  H0344-  X 

MV  OP  PUBLIC  OFFICERS,  AGI.NIS  AND  LMPldYLfS  OF  STAIl  DAIRY  CAL.  C1A86-  4 
ft OXERS.  CASH  BUYERS  AND  -  FOR  HANDLING  CLASSES  UF  FARM  CAL.  10 741  6 

NO  DISABILITY  INSURANCE  -  F  ROM  PAYING  OR  SHAMING  CUMM|'»  FLA.  CO  JBI-  / 

ES  OP  PROCESSORS  ANO  OF  -  OF  FARM  PRODUCTS.-  AMINOS  1  *U  CAl.  C07S8-  * 

E  MOTOR  VEHICLE  LICENSE  -  •  TO  DEFINE  RlQUtftlO  L l GAL  CAP  OKLA  HI0I1-  4 

0  REVISE  PROVISIONS  POR  AGES  AND  WORKING  HOURS  UF  Ft  Mbit  CHI  WYU.  COIHl-A/ 

C  EMPLOYEES  BETWEEN  THE  -  OF  40  AND  64.-  H.  MfMIlKlAl  ORGI  NlwM  ROGIO-At 
NO.  OP  CHILDREN  BETWEEN  -  UF  4  ANO  |H  ANU  PRLSCMIBl  NULLS  Nil*.  LOlOb-  t 
MR  ACTOR  POR  PAYMENT  TO  AGGRIEVED  EMPLOYEE  PINOING  I  INAi  Dll  Fl  A.  COJBOB.' 

TO  AUTHORIZE  VOLUNTARY  AGRIIMENT  FUN  DFSTRUCIIUN  0*  Mf  Ht)  BY  CAL  .  CL3J4-  4 
TEO  PROPERTY  SETTLEMENT  -  IN  OlvORCf  ACTION,  TO  OUl  CAl.  COBM-  » 

Al  LURE  TO  PRE  REQUIREO  -  ADOS  III  I  CH.  b/ ,  RE  TAX  MASS  CC496-  I 

BENEFIT  OP  A  REPURCHASE  -  .♦  AMENDS  SIC.  1,  46.  A  M4SS  C03/4-  | 

AMOR.-  DEFINES  UNLAWFUL  A&ftf.  t  Mf  NTS  RY  ShIPPIRS  AND  CARRIERS  NIB.  LOb//-  l 
VIDES  PUR  CONTRACTS  AIN)  -  I  OR  CONSIRUC I  ION,  MbINJEN  "ASS  C04I2-  / 

JOINT  ANO  INTER-AGENCY  -  EUR  PL  Rf  OHM  ANIL  UF  SIR  V  It  CAl.  COWO-  « 

OR  TO  MAKE  CONTRACTS  OR  -  WITH  STAIL  OR  FEOEKAL  AGI  CAl.  C|4«t- 

GHWAYS  ANO  TO  AUTHORIZE  -  WITH  IHC  U.S.  SELRLIARV  U  R.l.  t.iSS-  G 

INC  BONOS  AIK)  AUTHORIZE  -  WITH  THE  DEPT.  (IF  PUBLIC  R.l.  C01b4-  X 

ON  TO  CONTRACT  ANO  MAKE  -  WITH  TMf  U.S.  DEPT.  UF  AG  "ASS  C0S6I-  I 

ON  TO  CONTRACT  ANO  MARI  -  WITH  TmC  U.S.  DEPT.  OF  Au  "ASS  CUS64-  1 

VALID  INSTALLMENT  SALES  -  .»  ESTABLISHES  LlMlTAIinN  NIB.  L0B14-  J 

616.20  THRU  416.29,  RE  AGNftUI  .TOR  At  AND  LIVESTOCK  FAIRS  fXM  f| A.  C0393-  » 

N  Of  LIBRARY  AT  ALABAMA  -  AND  MECHANICAL  CULlEGl.  At  A.  A0486-  I 

AL  ACTIONS.*  ADOS  19.9,  *  CODE,  TO  DECLARE  LEGISL  CAL.  CfiNlb-  1 

60.9,  I03B ,  10/1.  1079,  -  CUDl ,  IU  RFVJSt  CEPflFI  CAl.  CtU/T-  7 
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2 


AGRICULTURAL 


AMENDMENTS 


I  PERSON.-  itttNOS  1241,  AG*  1  LuL  T  UK  41  CGDl.  lORtVISt  AND  I  Ml  U(,  tof*7  * 

ooucrs.*  aminos  ooo.ii  -  cuvi.  »»  incrlasf  appli  cal.  to»*«  « 

NINOS  lln.tli  IfH.II,  -  Coot,  10  REDEFINE  FARM  CAI  .  LOB  12  * 

ION  MOMMI,*  ADOS  »l,  -  COOt,  ftt  BTJVINt  TU81RCU  CAt  .  til**  *> 

•*.  ACPI  ACS  nu,  MOT,  -  COOE,  10  RLVISI  PHOVISI  CAt.  0666-  A 

ML  AC  (AC  Fttriuim  AMO  -  MINERALS  AND  REVISES  tn  CAt.  tl02»-  7 

I AL  AIO  POP  INDUSTRIAL,  -  ,  TtCHMICAl  ANO  VOCATION  NASS  CCS62-  » 

with  the  u.s.  ocpr.  op  agriculture  and  certain  tuwns  for  co  pass  cn*6t  » 

FUNCIfONS  FROM  OCPT.  OP  -  AND  CuNSf  A V A I  I  ON ,  SI  Aft  A.I.  COO/A-  i 

WITH  THE  U.S.  OCPT.  OP  -  10  CONSTRUCT  RESLRVUIRS  MASS  LOSA*-  « 

THORITE  COMMISSIONCR  OF  -  To  RCCUt Aft  SIANOAAUS  Tm  S.C.  AO?**-  I 

EMBERSHlP  OM  TMC  PUBLIC  AID  ADVISORY  BOARD  FROM  UPtAAIION  OF  lit.  H06B4-  I 
OWNS  FURN1SH1NC  OLD  ACC  *  AND  IO  OtLtTf  PROVISION  AS  10  IO  NASS  COS66-  I 

t  STATE  TO  SCCK  FEDERAL  -  >  OR  I  "PROVE Nt NT  ANO  PAVING  4JF  tt  NtWN  RCQ09-AI 

ON  (APEM&IS  FOR  MEDICAL  -  FUR  INDIGENT  RK»flVIS.<  AHiNDS  PA.  A0)*1-  2 
0  PROVIDE  FOR  FINANCIAL  -  I  OR  INOUSIRIAL,  AGRICUt (URAL,  Tt  NASS  CO**?-  1 
TO  REPAYMENT  OF  FEDERAL  -  FUR  ILMPORARY  UNEMPLOYMENT  CUNPI  NICM  PD2/6-AK 
OM,  PROVE 01 MC  FOR  STATE  *  IUR  VO  ANO  AIM  CLASS  SCHOOL  OISI  PA.  AO JM-  I 

II  OF  PERSONS  RECEIVING  -  IN  CERTAIN  CASES  AND  PHUVIOLS  EG  NIK.  10100-  6 
F  NATURAL  RESOURCES  ANO  -  IN  All  REGULAR  EtOCRAl  PROJECTS.  DEL.  SO??*-  I 
IS  CH.  AO- 10,  RE  PURLIC  -  RESERVE  I  UNO  ANO  PROVIDtS  FUR  Ul  R.l.  L0196-  I 

OF  THE  STATE  PRISONERS  -  SUCIEtv  AS  A  NtHABIl 1 1  At  ION  CtNI  Dtt.  M0B12-  * 
FUNOS  TO  THE  PRISONERS  -  SOCIETY  Uf  THE  STAIE  FUR  OPtRAI  I  DEC.  HOAII- 
ANCC  HOBOING  Df  LANS  RE  -  HI  FARIIIES  MlVH  OEPINUENf  CHILD  NASS  COAJ?- 
ACTS  IV*?,  RE  FINANCIAL  -  10  NECOY  DEPENDENTS  UF  VETERANS  NASS  C09J7-  I 

VIDE  A  PLAN  POR  MEDICAL  -  TO  QUALIFIED  PERSONS  A*  OR  UVf*  NEB.  LOIOO-  r. 
PROVIDES  FOR  FINANCIAL  -  HI  SCHOOLS  OFFERING  SUCH  Cl  A$SC-  CRIA  R002B-AG 
ETC.-  PROVIDES  FURTHER  -  If?  IME  SlINO  10  PROMOTE  SECT-CAR  At  A.  AG97B-  / 
PR OV IOCS  FUNOS  TO  -  VARIOUS  VETERANS  ORGAN I? AT IUNS. '  DEE.  HOOBO-  * 
E  UNDER  LAM  FOR  OLD  ARC  -  .-  AMCNOS  1,  Ch.  I1BA,  IU  INCRCAS  NASS  CCSSO-  I 

LICAMON  FOR  DISABILITY  -  .-  AMENDS  ?,  1160.  At  PURLIC  Will  NASS  COJAY-  . 

t  OP  RECIPIENT  FUR  SUCH  -  .  IIC-»  PAOVlDlS  FUR  I  MLR  AID  TO  I  ALA.  AO*?*-  « 

RIOUS  FUNOS  FOR  OLD  ACE  -  •  "LNlAl  HEALTH,  SCHOLARSHIP  ANO  ALA.  A09R9-  « 

f  AND  RECEIVING  FEDERAL  -  »  T«  t ■ Tt  NO  COVERAGE  TO  COVER  IMP  Die.  SO??*-  I 

ION  OF  REFRIGERATOR  ANO  AIR  CONDI f I OMlMC  SYSlINS  BV  THE  DIF!  NASS  C0*6I-  ? 
FATE  MILITIA  TO  IMCLUOC  -  UCFCNSE  IECHNICIANS  ENPtOVEO  ON  NASS  C0BO6-  1 
OS  OF  HEALTH  10  CONTROL  -  POLLUTION,  10  PRESCRIBE  FINES.-  "ASS  COABJ-  1 
FIRE  AUTHORITY  TO  LEASE  -  RlGHlS  UN  BOSTON  EXTENSION  AND  p  NASS  COSOS-  1 
I,  Of  AERONAUTICS  AS  TO  AIRCRAFT  AWAAOED  CERTIFICATES  IN  CfV  ILL.  HOOBI-  I 
PE RAT OR,  APPRENTICE  ANO  -  FOR  USE  IN  BUSINESS  OF  PEST  CAE.  CIO??-  ? 

CEMENT  OF  REGULATION  OF  -  «  NUlOR,  AAH  «.*0  PIPELINE  C  NEB.  LOOK?-  V 

Nt*  ALCOHOLIC  LI  DOORS  ON  AIRPLANES  UNDER  ON-PREMISES  LICENSE.  CAI.  CI?IB-  I 
CR  OF  CITY  EMPLOYEES  TO  AIRPORT  AUTHOAHICS,  TO  CLARIFY  PROV  NIB.  toil*-  I 

H  POWERS  ANO  DUTIES  FOR  -  AUTHOR  lilts  FOR  PROMOTION  OF  NEB.  L06BB-  1 

AS  TO  LANOINC  FEES  ANO  -  FACIE  I  TIES  UN  PRIVATE  LANO  A  NEWM  COJIB-  * 

UR  CONVERTING  NORTHWEST  At  A.  JUNIOR  COLLEGE  TO  A  TRADE  SC HOD  ALA.  AOS40-  ? 
STRUCT  ION  OF  LIRRARV  AT  ALABAMA  AGRICULTURAL  AND  MECHANICAL  ALA.  A0SR6-  I 
CNALIV  FOR  GIVING  FALSE  ALARMS  l»*  ifFWIi  IN  RURAL  EIRE  PRUT  NEB.  LOSSY-  I 
AMO  ORGANIZATION  OF  THE  ALBUQUERQUE  METROPOLITAN  AAROTU  FI  00  NEWM  COTII-  V 
OR II INC  USE  ANO  SALE  OF  AlCOCGI  ANO  SAIL  OF  ALCOHOLIC  LIQUOR  MASS  COBBY-  I 
CENSE  FUND  Of  THE  STATE  AlCDnULIC  BE VEAAGl  CONTROL  llOARD. ■  A  ALA.  AQSBY-  2 

ER  REGULATE  PURCHASE  OF  -  LIQUOR  BY  STAIE  EIQUOH  CON  NEWH  CO)}?-  / 

H  BUSINESSES  SELLING  NO  -  LIQUOR  EKtfPI  BEER.-  ARC NC  III.  H066S-  ? 

CR  OF  ON SALE  OR  OFFSALE  -  LI  DOOM  GENERAL  LICENSE.-  A  CAL.  CIBMY-  » 

o,  191,  ISA,  CM.  AS,  RE  -  L I  DOOR  LICLNSLS.  TO  RCYISI  ILL.  M06M-  ? 

OF  ITS  ON-SALE  GENERAL  -  LIQUOR  LICENSE  IU  ANO! HER,  CAL.  C1066-  » 

FOR  TRANSFER  OF  CERTAIN  -  LIQUOR  LICENSES  ISSUED  ON  CAL.  C16Q6-  I 

S  BY  HOLOCRS  OF  CLASS  A  -  LIQUOR  LICENSES,  10  ADO  BA  R.l.  C01BY-  2 

UUTAS  OF  CLASS  •  RETAIL  -  EIWUOA  LICENSES.  10  PAOVIG  MIS.  $0129-  I 

INTEREST  IN  MORE  THAN  2  -  EIGUOR  RETAIL  LICENSES  AFT  NEB.  1010*-  / 

NO  PROFESSIONS  COOC,  RE  -  LIQUOR,  TU  REGULAIC  CME01I  CAL.  C1BYI-  I 

HUE  UNOCR  INFLUENCE  OF  -  LIQUOR,  NARCOTICS.  BARBITU  MASS  C0J6Y-  I 

S  A— 141,  RE  SHIPMENT  OF  -  LIQUOR,  To  REVISE  REGDLATI  S.C.  AO?YO-  ? 

S  GOVERNING  THE  SALE  OF  -  LIQUORS  WITHIN  SPECIFIED  0  ILL.  M046*-  ? 

SE  PROVISION  RE  SERVING  -  LIQUORS  ON  AIRPLANES  UNDER  CAL.  C1?1B-  * 

PROHIBITION  OF  SALE  OF  -  LIQUORS  NEAR  CERTAIN  STATE  CAL.  C1BJ?-  I 

OF  ALCOHOL  ANO  SALE  OF  -  LIQUORS  ON  PRESCRIPTION.-  MAS*  COBBY—  l 

INAL  SECS,,  RE  SALES  OF  -  LIQUORS  To  MINORS  ANO  INCU  NEB.  LOIOY-  ? 

DOS  SECS.,  TITLL  IT,  RE  -  LIQUORS,  10  PRESCRIBE  NEW  ALA.  A0SB9-  ? 

ANO  PROFESSIONS  COOC  RE  -  LIQUORS,  10  MARE  EDI  TORI  At  CAL.  CIOBO-  6 

,  91-142.01,  9F-IAB,  RE  -  LIQUORS.  Ill  ELIMINATE  USE  NEB.  LOOBB-  B 

AMO  I HOSE  RE  SINGLE  USE  All  UK  BIER  BOTTllS.-  AMINOS  AND  ACM  CAL.  CIOBO-  6 
PROCEDURES  CONSTITUTING  AC|Nt*V  DCCRlf  ORDERING  CONVEYANCE  O  NASS  CUB!*-  2 

WCCS  IN  DETERMINING  THE  ALL  - 1  NCI  US  I VE  PER  OlfR  CHARut  S  ANO  C  NASS  COBJY-  I 

M  WEIGHT  INC  FORMULA  FOR  AllUCA  I  INC  ANO  OISIR  I  Bill  ING  THE  EQUA  NlWM  COJIO-AX 

EE  FUR  I  HEN,  TO  REQUIRE  Alt  IH.A  I  I  ON  OF  PARI  OF  FUNOS  FOR  STOC  NO.D  C0IY2-  t 

R  OCIERMINING  AMOUNT  OF  ALLOWANCE  ACCORDING  TO  NEED  ANO  CSTA  ALA.  AO*?B-  ? 

DETERMINING  AMOUNTS  OF  -  ANO  CONtHIBUllUN  BY  STAIE  MASS  CO*)?-  I 

OF  DEFERRED  RCTIRCNCNf  -  AND  DEFINITION  OF  ACTUARIA  R.l.  COO**-  ? 

SE  COMPENSATION,  TRAVEL  -  AND  EXPENSES  Uf  MEMBERS  OF  MASS  10106-  I 

C  ADO  I T I  ON  AC  RETIREMENT  -  FUR  MEMBERS  OF  UNIFORMED  tt  MASS  COBAI-  ? 

EASE  SERVICE  RETIREMENT  -  FUR  MUNICIPAL  EMPLOYEES,  U  A.I.  C02I?-  ? 

SB  TO  INCREASE  PER  ©IBM  -  FUR  TRAVEL  ON  OFFICIAL  BUS  MONT  HO  IB?-  1 

SUPPLEMENTAL  RETIREMENT  -  FUNO  FUR  STATE  EMPLOYEES,  PA.  AOJSV-  1 

S,  TO  PRESCRIBE  HOUSING  -  IN  LIEU  01  A  RESIDENCE.*  A  WIS.  $0016-  I 

UY I SION  LIMITING  TRAVEL  -  OF  SUPERVISORS  IU  MILEAGE  CAL.  CIIBB-  « 

V.  ANO  TO  LINK  MILEAGE  -  OF  IHOSE  WORKING  IN  PLACE  MASS  COBuf-  1 

ON  A  SERVICE  RETIREMENT  -  To  INCLUDE  PUBLIC  SCHUU.  t  R.l.  (.01*9-  ? 

ELECT  LESSER  RETIREMENT  -  f«l  PROVIDE  A  SURVIVOR  Bf Nt  MASS  C0S26-  ? 

LEISURE  TIME  ACTIVITIES  -  UNDER  LAW  TOR  OLD  ACC  AIO.  NASS  COB*U-  I 

OJUSTMCNT  OF  RETIREMENT  -  ADOS  4)*»F.4,  GOVERNMENT  CAL.  C?0?6-  I 

PENSIONS  ANO  RCIIAfNCNT  All  USANCES  OT  CERTAIN  FUNMfR  PUBLIC  MASS  C0B7B-  / 

IN  SALARIES  ANO  CAPE  NSC  -  OF  l!  GISH  TO**.  ANO  Uf  YAH  WIS.  C022S-AM 

OPTIONS  FOR  PAYMENT  OF  -  IU  Cl  A I A I N  BtNfflCIARlES  MASS  LOBYf-  I 

*EM*I9*S  OR  RETIREMENT  -  »  TO  INCLUOL  SERVICES  FOR  MASS  C0B62-  ? 

L  CONVENTION  TO  REVISE,  ALItR.  AMINO  EXISTING  OR  TO  FRAME  A  R.l.  C021I-  * 
CODE,  RE  CONSTRUCTION,  At  If  RATION  ANO  REPAIR  UF  CUUNTY  BUIl  CAI.  f.OBRB-  ( 
F  PLANS  FOR  ERECTION  OR  -  uF  INSTITUTIONS  UNOCR  IHC  PA.  AOJ96-A » 

IN  APPLICAT ION  FOR,  OR  -  Ul,  GAME  ANO  FISH  LICENSE  NO.D  1014)-  / 

AMOR  OF  USE  OF  FALSE  OR  AL  II  Nt  i)  IDE  NT  IF  (CAI  I  UN. «  AN*  NOS  *)-l  NfB.  LOIOY- 

VACANCIES  ANO  CHOOSING  AL  f  I  RNAf  E$.  •  AMENDS  lA.fMII,  RE  LON  WIS.  St)2*l-  I 

NO  HOUR  ANO  PROVIDE  FOR  AllfPNAIlVlS  Uf  SIASON  f OR  I AK ING  AN  NU.U  COIYI-  1 
CONDITIONS  NAMING  THIS  AMENDMENT  INUPERAIIYI  UR  CANCELING  N  CRIA  ROSFF-A) 
I.  RESOLUTION  PROPOSING  -  Uf  ART.  12.  SIC.  II  Uf  STA  NEwN  ROOH-A? 

S0CUI10N,  PROVIDING  FOR  -  Uf  *49.11,  II  HE  t,  IO  PROV  UREA  R0SW-A2 

ITUITON,  RE  LEGISLATIVE  “  UR  AEVISIUN  Uf  STAfUfES,  I  Nl »N  RO02A-AI 

H  ELECTION  ON  PROPOSED  -  TU  ADO  NE«  SEC.  Tii  ARI.  Iu  UKLA  R0S1S-AG 

I.  RkSXU-lON  PROPOSING  -  Hi  ARI.  7,  SEC.  1  OF  ST  ATI  Nl  WN  ROOlJ-At 

1.  RESIvQTION  PROPOSING  '  IU  AA».  II.  SECS.  *.  ?,  8,  Nl  mH  ROOlT-AA 

IMS  10  ANO  IB  PROPOSING  -  IM  ART.  I,  SEC.  1?  OF  SlAf  NEWM  R00l«-A^ 

I.  RESOLUTION  PROPOSING  -  ly  ART.  B,  SEC.  1*  Of  *IAT  Ot  WN  ROO.'6-Rt 

T.  RESOCUT  ION  PROPOSING  -  ID  ART.  «*.  SEC.  UF  MAT  Nt-N  RC002-A1 

OR  ELECTION  ON  PROPUSEO  -  •  **>•  ’•  1*  STATE  L  GALA  ROUII-Af 

RESOLUTION,  BE  PROPOSED  •  »  ‘  ***•  't  .11.  ?l.  STATE  0*1  A  Ro*J7-A! 

.  NOV.  19*4  OF  PROPOSED  -  Ti.  ARI.  B,  .tt.  t,  STATE  L  NEB.  LCO*.--  / 

flOH  RATIFYING  PRUPOSEO  -  *U  l  CNST I IUT IUN  I5f  U.S.  Ill  NE»N  RCDUI-Al 

RESOLUTION  IS  PROPOSING  -  RfPlAl  IhE  Cl  U  AND  ENAl  «wn  ROOIM-Bt 

T.  RESOLUTION,  PROPOSES  -  *E**»*E  <-fi-  >*•  '•  “IS*  *UOj?-Al 

,  IYAA,  EOR  APPROVAL  OF  -  VUHNlARV  VI  AN  ALJuMI*  CAI.  Ll?l.'-  » 

UF  BONOS  UNDER  PROPOSED  I  I  «•  ■  "  T*’»  SlAlf  U  :«  »»ITu  »:  *1  .  C>  -  f.  . 


ANO  Ft  C  PROVISIONS  FOR  ANf  NUNf,  NIL  BY  OflMtSTIt  «M>  MJRFIGN  C  ALA.  AC**S 

THORITE  JUOGES  TO  ALLOW  -  OF  PLEADINGS  AND  (IT  PRCf«  CAI.  CORN?-  « 

STATE  POLICY,  CFFfCI  OF  -  UF  iHl*  ACT  (IN  |Nlf  RPRE  f  A  CAL.  CI7*B*  * 

R  RESOLUTIONS  PROPOSING  -  10  CONST  I  TUT  ION. -  RE GUI  A I  PA.  AOJI*- 

PCALS  AMD  REENACTS  WITH  -  7B6Y/,  7**4),  GOVERNMENT  CAI.  CIB4Y-  • 

AN  ANO  ADMINISTRATOR  OF  ANIMAL  HUSBANOR <  TO  OCPT.  UF  HI AL I M,  H.|.  C007B 

NG  GAME  BIROS,  FISH  A  NO  ANIMALS  ANO  lOITCRIlS  FUR  E  I  N|  Ti  0  Nli  NU.U  COIYY-  I 
UNN  ING  AT  LARGE  OF  SUCH  -  AUTHOR  1 2 1 S  COUNT  l»  S  HAVING  NIB.  101GI-  .’ 

ATIMi  TAXATION  OF  DRAFT  -  ,  SHEEP,  GOATS  ANO  HOGS.*  RfP  NftnH  COJIR-H? 

IR  CERTAIN  DUTIES  AS  TO  ANNfXAIION  f  ROM  STATE  COUNCIL  UF  EOu  PA.  AUJ7B-  , 
(COOC  99,  TITLE  9>l»  RE  -  UF  CERTAIN  ScuUUt  UlSTRIc  PA.  A017B- 

II,  GOVEBNMtNT  COOC,  RE  -  OF  TI  ARMORY  TO  CM  IIS,  I  CAL.  C0B6?-  t 

IONS  ANO  PROCEDURES  FOR  -  Uf  TIDE  UR  SURMEmgEO  LAND  CAL.  C10Y4-A* 

RCORGAMMATION  PLANS  OR  -  PROCEEDINGS.-  ADDS  SUBStC  NO.D  C017I-  I 

AAITORT  PROHIBITED  FROM  -  TU  A  CITY  III  INCLUDE  AREA  CAL.  tl*V4'R* 

ORATION,  CONSOLIDATION,  -  »  ETC.,  OF  CMIFS.  CfYS.,  Cal.  Cl  I*?-  * 

IB,  GOVERNMENT  COOC,  RE  ANNEXATIONS  10  A  CITY,  IU  PRESCRIBE  CAL.  CIBYB-A*. 
0  VOTING  BY  ELECTORS  OF  ANNIXLD  TERRITORY.-  AMENDS  ANO  MtENA  NU.U  CUI7*-As 
ROUNOCO  BT  LANOS  OF  THE  ANNE  KING  CITY  ANO  THE  PACIFIC  OCE  AN.  CAE.  C1BYB-H4 
REQUIRE  ADVERTISING  AND  ANNOUNCEMENT  AS  TO  DIFFERENCE  OF  f KM  CAt.  CIJBY-A* 
TIES  FCR  MISOCNEANOR  OF  ANNOYING  AND  OBSCENE  TELEPHONE  CALLS  At  A .  A0VB7-  I 
Nl  BENEFITS  FOR  CERTAIN  ANNUITANTS  Uf  PUBLIC  SCHOOL  (RPLOFEI  PA.  AUJ76-  B 

BT  BENEFITS  FOR  CERTAIN  -  OF  STATE  EMPLOYE* S  RtTIMt  PA.  A0J6B-  B 

ACS  FOR  THE  PURCHASE  OF  ANNUITIES  FOR  EMPLOYEES  UF  STATE  DCP  NASS  C0B66-  B 

LICT  OR  OF  A  BENEFIT  OR  ANNUITY  PLAN  OF  NUNPROf I  I  ORGANl/Atl  WIS.  S00B6-AI 

FOR  LIFE  INSURANCE  ANO  -  POLICY  FORMS  WITH  DIRECTOR  U  NIB.  LOB72-  / 

IVOR  BENEFIT,-  PROVIOCS  -  TO  WIDOWS  OF  SIATE  PULICINEN  NASS  C0*?6-  / 

,  SEPARATE  MAINTENANCE,  ANNULMENT  OM  FOR  SUPPORT  UR  CUSTOOY  CAL.  CIJIJ-  * 
PENCE  IN  PROVISIONS  FOR  ANSWER  TO  SUCH.-  ADDS  16-19-01.1,  AM  NO.D  COI«B-  .» 

OF  OCCR  AMO  TO  INCIUOC  ANTLLUPt,  REPEALS  70-09-0?. I  PRESCRI  NU.O  C01Y7-  I 
P UOMS  FOR  MOTORCYCLES,  ANTIQUE  AUTOMOBILES,  FARM  TMACIURS  A  MASS  COBDV-  .< 
CNFORCCNCNI  OF  FEDERAL  ANTIlRUSl  LAM.-  PAESCRIBFS  METHOD  FO  ALA*.  A099B-  1 
RATIVE  OR  MULTIPLE-UNIT  APARTMENT  BUILDINGS,  PRESCRIBES  REOU  IUWA  SOU?-  X 
WELL  IMS  OR  COOPERATIVE  APARIHENIS  AS  IU  MASTER  DEED.  UNI  I  O  MASS  COBY  *-  Y 
CS  ANO  RIGHTS  AUTOMATIC  APPf AL  ANO  STAY  OF  JUDGMENT  RCAPPORf  •NEWM  COOU? -  *• 

INDIGENT  DEFENDANT  FOR  -  IN  CRIMINAL  CASC  Al  LRPCNSt  O  ALA.  AO*?*-  * 

SIDCNCE,  TO  PROVIDE  FOR  -  TO  StAfE  BUArO  OF  PUBLIC  SCHII  NO.D  C0I6B-  ? 

AND  DISTRICT  COURTS  OF  -  .«  AME  NOS  6BBB  7 •  69IBJ.  REPEAL  CAL.  C0B7J-  B 

JUOGES  OF  THE  COURT  OF  APPEALS  AND  CIRCUIT  JUDGES  AND  COMF1  /KV.  $0001-  t 
T  ANO  DISTRICT  COURT  OF  -  AND  PROVIDES  FOR  SElfCIlON  A  CAt.  C1J9J-  t 

DOING  BUSINESS  PE NO ING  -  AND  IO  PRESCRIBE  REGULAf IONS  ILL.  HD6JI-  ? 

ICW  OF  OCCISIOMS  OF  THE  -  BOARD  BY  fHl  DISTRICT  COURT.  NEWM  COJUB-O* 

EAlt  ADVISORY  BOARD  AND  -  BUAMU  INERlFUR  IN  THE  OEM*  PA.  AOJB?-  m 

SC  TINE  LIMITATIONS  FOR  -  IN  PROCEEDINGS  FOR  RLYOCAMo  IU.  H06JI-  / 

RESCRIBE  PROCEDURES  FOR  -  10  IHE  SIATE  LABOR  AND  INDUS  NEWM  C0J0B-06 

SI  ONERS  OF  THE  COURT  OF  -  .-3D  EX.  SESS.  REPEALS  6B.BY  /RV.  S0061-  » 

EDUCATING  JURISDICTION,  -  ,  COSTS  ANO  f CIS  IN  CIVIL  CAS  NtWH  C0J1I-BK 

OR  PETITION,  HEARINGS,  -  *  CNFURCEN.nI  AND  COLLtClinN,  0*1 A  H0697-BA 

CORPORATIONS,  RE  EON ING  -  ,  TO  PRUVlOC  FOR  SfAGGEAlD  a?  AtA.  A096J-  / 

AMS  COURT,  TO  AUTHOR I EE  APPEARANCE  OF  TAXING  AUTHOR  1 1  ICS  AS  PA.  AO  1*0-  I 
PROCEDURES  FOR  NOTICE,  -  ,  FAILURE  10  APPEAR,  CNF  OR  MASS  C0B9I-  ? 

RE,  TO  EXEMPT  JUOGES  IN  APPELLAIC  DEPIS.  UF  SUPtRIOR  COURIS  CAt.  COB??-  • 

Y  ANO  RULES  OF  EVIDENCE  APPLICABLE  UN  FAILURE  TO  COMPLY  WITH  R.l.  CO?Ol-  I 

E  LAW  VIOLATORS  ARE  NOT  -  TU  COMMERCIAL  CARRIERS  Of  MASS  COIBO-  I 

Y  REFERENCE  MAKING  THEN  -  TO  DOMESTIC  FRAT1RNAC  BEN  MASS  C0*?1-  / 

MEMICALS  ANO  HAKE  SECS.  -  TO  FIRMS,  PARINERSH|PS.  A  NO.D  CQIB6-  ) 

FOR  LICENSING  QUALIFlfO  APPLICANTS  AS  RASIlR  OR  JOURNEYMAN  G  MASS  COT??-  2 

Y  PATIENT  TO  RELEASE  ON  APPl  ICKUON  AND  PROCEDURES  IUR  PROCC  FLA.  LuSIB-  2 

RESCRIBE  PBOCEOURES  FOR  -  BY  CERTAIN  FRISUNLRS  FOR  MASS  CCBB6-  ? 

TO  REVISE  ANO  INCREASE  -  FTC  FOR  LICENSES  AS  COMM  CAI.  C079I-  0. 

TURAL  COOE,  TO  INCREASE  -  Ft*  F««  UCCNSCS  Of  PROC  CAL.  CuTSB-  * 

RSONS  ELIGIBLE  PRIOR  TO  -  FOR  DISABILITY  AID.-  AWk  MASS  COI«b-  . 

SCRIBE  REQUIRE RENTS  FOR  -  FOR  TRANSFf R  OF  UNSAl  L  U  CAt.  CI6«v-  I 

OF  NISRCPRCSCNTATION  IN  -  F0«.  OR  ALUNAIIDN  UF ,  G  NO.D  COIYI-  ? 

OCEOURCS,  REQUIREMENTS  *  -  FORMS  ANO  TABULATION  ANO  R.l.  C007I-AY 

ED  IN  STATE  TO  RESTRICT  -  OF  FORMULA  FOR  ESTABLISH  ALA.  AO/**-  ? 

IN  THOSE  EXCEPTED  FROM  -  UF  SEC.-  AMINOS  l?6U6,'tt  CAI.  C040J-  t 

AL  REVISIONS  ANO  CXTCNO  -  OF  SIC.  IU  VIUI AIION  OF  MASS  C0B9I-  * 

R  CONNECTING  LINKS  FROM  -  UF  SCC.  ANO  Cl  AM  I F  Y  IHL  NIB.  LOO*?-  . 

LITE  TINE  UNIT,  EXP  ANO  -  *0  INClUOt  CIVS.  OF  *,QU  ILL.  MQ079-  2 

NO  ADO  PROVISIONS  AS  TO  -  TO  MULTI-UNU  ACCOMMUDAI  *OMr  .  COOGB-  J 

OL LCCTCO.-  PROVIOCS  FOR  -  ,  FEL  AND  ISSUANCE  Of  JO  NIB.  10766-  » 

R  NOTICE  ANO  HEARING  ON  APPLICATIONS  ANO  ME VUCAT I ONS . •  AOtHU  NIB.  10764-  t 
90  TO  INCREASE  FEES  FOR  -  POR  AND  RENLWAl  (IF  LIU  R.l.  C0I9R-  * 

U.S.  AS  COURT  REPORTER  APPOINTEES  ANO  PRESCMIBI  MtQUlREMlNI  CAL.  CI?G»-  * 
NO  PARTY  AFFILIATION  OF  -  UF  JUOGC  OF  EtlCIIONS  AND  NU.U  COlwl- 

O  PROVIDE  FOR  STAGGERED  APPOINTMINI  AND  ADDITIONAL  REPAIRS  f  ALA.  A096I-  2 

A  CTY.  ANO  PROVIOCS  FO*  -  AND  tlEUION  Of  JUDGiS  I  PA.  AO?«H-  » 

BOARDS  ANO  PROVIDE  FOR  -  AND  FIXING  SALARIES  OF  f  WIS.  C022*-An 

PERSONS  RESPONSIBLE  FOR  -  AND  FAR  I V  Af FILIATION  OF  NO.D  COI.I-  2 

{STRICT,  TO  PROVIDE  FOR  -  AND  SALARY  UF  A  ?0  AS$|$  m*S*  CO*M*  I 

OV  IS  IONS  TO  PROVIDE  FOR  -  BY  T  OME  STIR  UF  AOOlMONA  NASS  C0972-  I 

DEFINES  MISDEMEANOR  OF  -  BY  SIAIL  ( nmi OYl t  S  AND  O  Al  A.  AQ**B-  I 

•  CM.  221,  TO  AUTHORIZE  -  UF  A  ID  ASSISTANT  CLERK  MASS  CU*U?-  I 

OFFICE  AND  PROVIDES  FOR  -  UF  ADMINI STRATUM  FOR  COU  FLA.  CO*?*-  * 

HO  A I  LED  TO  Pt'TIlfCNf  FDR  -  UF  DfPUIIES.-  AMINOS  101  FLA.  L0?*6-  I 

1  PARTY,. TO  rilfMFlDt  FOR  -  Uf  fURHEM  UGISIAIURS  AS  NO.D  LOltt*-  I 

EDO At  FOR  SELECT tON  ANO  -  UF  JUOGES  OF  JUSTICE  COU  CAI.  Cl  401-  l 

L  BOARD,  TO  PROVIDE  FOR  -  Uf  MEMKIRS  BY  GOVERNOR.-  R.l.  CQ049-  2 

l  TEAMS  AND  PROVIDE  FOR  -  UF  MENHIRS  Of  VARIOUS  B(J  WIS*  C022*-B» 

N JUNCTION,  DISSOLUTION,  -  OF  Rf CLIVERS,  EIC.-  ADDS  CAI.  Cl  12 7-  » 

STEM  ANO  TO  PROVIDE  FDR  -  UF  RE  I  IMF  D  PERSUNNCL  WIT  CAL.  CIBJO-  ( 

REGULATE  PROCEDURE  FOR  -  OF  TEMPORARY  HEADS  UF  CL  PA.  AOJOI-  • 

E  OF  REPRESENTATIVES  Bt  -  UF  THE  GOVERNOR  AND  IN  I  MAw.  A0|00-  » 

OR  AM  IN  THE  SENATE  BV  -  UR  ELECT  I  UN,  DEPENDING  I.  HAW.  *'>100-  » 

ANO  REGULATE  CREATION,  -  TO  AND  UP!  RAT  ION  Of  JO  IF  A.I.  CC»?U6-  *• 

FOR  DETERMINING  LOSS  OF  APPilM  T  HINnENT  TO  DISTRICTS  w|TM  UNQU  NIB.  IQIU6-  » 
CAIE  FEES  FDR  OPERATOR,  APPRINIICE  AND  AIRCRAFT  FUR  USl  IN  tt  CAL.  C1027-  / 

R,  ACTS  I9AS,  TO  DEFINE  -  PLUMBERS,  PRUVIDI  THAT  Tm  MASS  C0BJ1- 

OEPlNf  TERMS  TO  INCLUOC  APPRLN1ICLS  ANO  CUMBINATIUNS  l^f  LMPt  R.l.  C0I42-A2 
t  OF  NEW  CASTLE  CTY.  TO  APPROPRIATE  FUNDS  TU  *Ml  PMISUNLRS  A  Dt l .  HQBll-  | 
OS  fOR  WHICH  ORIGINALLY  APPMCPRI  AT  CD  AND  PRUVlDE  FUR  AOJUOIt  NtB .  (0046-  .• 

ECS.,  BE  IRRIGATION  ANO  APPRi.PR  1 A  T I  UN  Of  WATtR.  TU  INCLUDE  A  MB,  t  UC46-  ✓ 
IRCCTS  THE  COMMITTEE  ON  tPPRUPRI  A  T  IONS  ANO  MUDGETS  «f  THl  l!  DMA  RG9UB-AB 
B-3,  AUTHORIZING  ANNUAL  -  BY  Cl  TIES  AND  TU-NS  !  R.l.  C0116-  . 

CM  FOTFEIfURCS  OF  WAIER  -  FOR  MTNUSt  ,  10  CtAMF  MB.  L0U49-  I 

ASS  CTYS. ,  TO  AUTHORIZE  -  TO  TUURISI  PROMOTION  PA.  AC16«-  2 

C  A  SONS  RETIRING  BETWEEN  APR  1 1  21,  1 46?  ANO  SEPT.  I,  146T  MAY  R.l,  CQ099- 

S. -  AMENDS  1404,  ACT  OP  -  4,  1924,  P.  L.  )BJ  ICUDf  1B0B,  PA.  AO?**-  *• 

ESCRIBED  LINITAI10NS  !N  ARBI (RATION  BETWEEN  INSURIO  AND  INSU  CAL.  Cl  7*0-  ? 
R  ABSENTEE,  SHUT-IN  AND  A«MfO  F  URGES  UR  WAR  VOTING.3  AMENDS  R.l.  C0C7L-AY 
NTS  OF  VETERANS  OF  U.S.  -  FORCES,  in  REVISE  M|  fnlJD  UF  01  "ASS  tu*»7-  I 

ION  IN  LIEU  OF  PHYSICAL  ARAL  SI  IN  CASt  Of  MGHl-MMi  ARREST  CAL.  Cl  *24-  » 

f  IN  CASE  OF  NIGHT-UNI  -  UN  WARRANT  FOR  N I  MlEMf  AND*  lit  CAL.  Cl*24-  ( 

TEES  WHERE  OFFICERS  HAY  -  wlfMUUf  A  wAPRANI  FUR  CtKTAIN  MASS  COM2-  . 

AIN  CANOS  WITHOUT  SPARK  ARRI  STIRS.-  RCPIAtS  BIOS.  *167,  PUHl  CAL.  C20 Jtt-BK 

LO  TURKEYS  WITH  BOW  AND  ARHtiwS  DURING  SPICIAl  SI  A  SUN  t  SI  ABU  NIJ.D  C014B-  I 

LBUOUERQUE  ME T RQPOL 1  TAN  ARRIP.YO  FCUOD  CONlROl  AUTHORITY,  PRC.  Nl  w-  COJII-  » 

OF  MINOR  I ALS,  WORKS  OF  ARTS  AND  LANDSCAPING.  ETC.,  Of  PURL  I  MB.  * 

N  OF  PROJECT  TO  IGClUOf  -  LI  Nil*  uf  i/UIH*,  -USM;".  AND  *1*.  A  G  M  R  • 


Observe  that  the  left  portion  of  each  entry  is  shaded  grey  to  highlight  the 
keyword  column  and  that  each  keyword  appears  only  once  for  quicker  recog¬ 
nition.  Figure  13  illustrates  what  can  be  done  to  remedy  the  chopped  title 
problem.  Here  103  characters  instead  of  the  conventional  60  characters  is 
available  for  the  title.  "An  analysis  of  the  lengths  of  titles  in  a  U500  - 
article  computer  literature  index  of  periodicals,  books  and  proceedings 
showed  that  30  per  cent  of  the  titles  would  have  been  chopped  in  order  to 

produce  a  60  character  single  line,  but  only  2  per  cent  of  the  titles  were 

(73) 

chopped  by  using  a  103  character  line."  The  103  character  format  is 
the  obvious  solution  to  the  chopping  problem. 

Hius,  objections  regarding  foimat  are  easily  rectified. 
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Figure  13:  The  103  Character,  Single  Line  KV7XC  Index  Format 
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V.  APPLICATIONS  OF  KWIC  INDEXING 


KVIC  Indexes  are  used  In  such  a  variety  of  applications,  that  It 
would  he  difficult  to  enumerate  all  of  them.  Donald  Kraft,  information 
retrieval  expert  of  the  IBM  Corporation  has  summarized  several  uses. 
Kraft  says: 


"KWIC  indexes  are  used  regularly  hy  a  number  of  companies 
and  organizations.  Perhaps  the  most  well  known  is  Chemical 
Titles,  published  twice  a  month  by  the  American  Chemical 
Society  as  a  current  awareness  program.  Each  issue  Indexes 
approximately  2,800  titles  of  chemistry.  Biological  Ab¬ 
stracts  use  a  KWIC  index  in  each  monthly  issue.  Bell 
Telephone  Laboratories  use  a  KWIC  index  to  disseminate 
technical  information  to  its  staff.  Trans-Canada  Airlines 
Indexes  its  procedural  manuals  with  KWIC  indexes.  In 
January  1963  the  American  Bar  Foundation  began  publication 
of  a  KWIC  Index  of  bills  enacted  by  the  90  state  legislations. 
This  current  awareness  service  is  published  approximately 
every  two  weeks  during  the  height  of  the  legislative  sessions. 
In  July  1962  the  American  Bar  Foundation  published  its  first 
KWIC  Index,  Index  to  Legal  Theses  and  Research  Projects  - 
1960-1961.  ...IBM  uses  KWIC  indexes  for  its  collection  of 
marketing  publications  and  procedure  manuals  as  well  as  for 
Indexes  to  current  EEM  research  projects  and  computer  program 
libraries."  (74) 


In  a  letter  to  the  author  dated  April  20,  1964  Mr.  Kraft  mentioned 
additional  applications  of  KWIC  Indexing.  One  of  these  called  a  "Respon¬ 
sibility  Index",  seemed  especially  novel.  The  index,  used  at  IBM  Head¬ 
quarters,  permutes  the  Job  titles  of  Headquarters  personnel  and  Instead  of 
a  reference  code  a  man's  name  is  used.  "Consequently  one  can  use  this  to 
determine  who  is  responsible  for  what.  ...The  American  Medical  Association 
uses  a  KWIC  index  to  the  signs  and  symptoms  of  diseases  in  their  publica¬ 
tion  entitled  "Current  Medical  Terminology."  Northwestern  Uhiversity, 
Department  of  Languages  (Greek),  used  a  KWIC  index  to  study  the  writings 
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of  Galen.  In  this  example,  the  entire  text  of  Galen  was  keypunched  in  a 
transliterated  form  and  treated  as  if  it  were  one  title.  The  listing 
proved  to  he  very  helpful.  Kansas  State  Uhiversity  produced  a  KWIC  index 
called  "Kansas  Slavic  Index",  which  is  a  transliteration  of  Russian  socio¬ 
logical  titles.  In  closing,  Kraft  mentioned  the  work  of  Professor  Kenneth 
Janda  of  the  Political  Science  Department  at  Northwestern  University. 
Professor  Janda,  to  the  surprise  of  this  author,  has  KWIC  indexed  236  recent 
political  science  doctoral  dissertations.  The  author  assumes  that  these 
titles  were  edited  hut  from  Professor  Janda'a  index  it  is  impossible  to 
discern  either  the  presence  or  amount  of  editing.  Perhaps  Professor  Janda 's 
political  science  index  suggests  an  ever  broadening  scope  of  activity  for 
KWIC  indexing. 


62 


VI.  CONCLUSIONS 

The  flood  of  research  papers,  scientific  articles,  government  re¬ 
ports  and  documents  of  every  description,  which  began  with  World  War  II  and 
continues  unabalted  today,  compounded  by  a  multiplicative  analysis  factor 
(the  number  of  anedytics,  extracts,  index  entries,  etc.  per  document)  has 
generated  an  alarmi.-jg  i nf o.'  .iation  morass.  Tbe  morass  per  se  is  harmless 
fire  consumes  paper.  The  harm  is  in  the  result  of  the  morass  -  the  diffi - 
culty  In  processing  and  retrieving  useful  Information.  The  severity  of  the 
Information  problem  has  sent  librarians,  documental! sts  and  information 
scientists  In  quest  of  means  to  expedite  the  handling  of  literature.  Dr. 

Dwight  Gray  of  the  National  Science  Foundation,  who  equates  information 
retrieval  with  experimentlon,  recently  wrote  "...the  processing  and  dissem¬ 
ination  of  the  results  of  research  -  that  Is  of  scientific  Information  -  Is 
as  Integral  a  part  of  the  total  research  sequence  as  experimentation  Is." 

He  then  concluded,  "the  prerequisite  to  a  solution  to  this  problem  Is  realistic 

recognition  of  Information  dissemination  as  a  blood  brother  of  experimen- 

(75) 

tation. . ." 

Science,  at  the  appeal  of  the  information  handlers  and  given  Impetus 
by  interested  constituents  and  government  funding.  Is  applying  mechanical 
innovations  -  notably  today's  newest  breeds  of  lightning  fast  computers  - 
to  all  aspects  of  the  information  handling  problem.  Clearly  there  are  vast 
horizons  for  mechanization  in  information  handling,  for  In  any  information 
storage  and  retrieved  system  there  are  only  two  tasks  which  are  exclusively 
assignable  to  man  -  the  choice  of  documents  to  go  into  the  system  and  the 
final  evaluation  of  the  usefulness  of  answers  by  the  user  of  the  Information. 
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In  between  these  two  points  Is  a  series  of  unit  operations  -  all  of  which 
may  be  performed  by  human  beings  and  some  of  which  may  be  performed  wholly 
or  In  part  by  various  machines. 

Within  the  analysis  unit  operation,  science  has  applied  machines 
to  abstracting,  extracting,  classifying  and  with  distinct  success  to  In¬ 
dexing.  And  of  the  various  forms  of  machine  Indexing  none  has  been  as 
successful  and  widely  adopted  as  keyword- In- context  Indexing  (KWIC),  the 
subject  of  this  thesis. 

After  traversing  the  deductive  path  to  machine  indexing  and  Jour¬ 
neying  along  the  path  stopping  in  succession  at  a  description  of  KWIC 
Indexing,  a  study  of  the  adequacy  of  titles  as  search  tools,  pros  and 
cons,  and  most  recently  at  applications  of  KWIC  indexing,  the  reader  might 
conclude  that  the  author  regards  KWIC  indexing  as  a  panacea.  Not  so! 

KWIC  Indexing  does  not  Impinge  on  nor  will  It  replace  other  modes  of  in¬ 
dexing,  with  the  possible  exception  of  the  shallow  alphabetic  subject 
index.  A  cure-all  It  is  not:  but  a  new  and  efficacious  weapon  to  attack 
the  information  problem  it  is'. 

The  author  feels  that  the  following  principal  conclusions  may  be 
elicited  from  the  preceding  discourse  of  KWIC  indexing: 

(A)  Titles  are  adequate  search  tools,  particularly  in  highly 
specialized  fields. 

(B)  KWIC  indexing,  despite  the  repairability  of  non-descriptive 
titles,  is  best  suited  for  highly  specialized  fields. 

(C)  Hie  KWIC  index  1b  useful  for  either  dissemination  or  retrieval. 


(D)  "KWIC"  offer3  many  advantages,  such  as  speed,  ease  of  pre¬ 
paration,  flexibility  and  cost,  but  few  disadvantages. 

(E)  Any  specialized  library  or  information  center,  given  sufficient 
funds,  or  direct  access  to  the  machines  necessary  for  preparing  a  KWIC 
index,  or  both,  should  give  serious  consideration  to  initiating  this  mode 

of  indexing. 

And  finally,  a  comment  regarding  the  study  of  the  adequacy  of  titles 
as  search  tools  is  appropriate.  As  stated  earlier,  several  similar  studies 
to  test  titles  have  been  conducted  in  the  past.  However,  their  results  are 
not  readily  comparable  and  suggest  limited  inferences.  This  is  because 
these  studies  covered  very  specialized  fields,  i.e.,  medicine,  law,  etc. 
and  were  performed  by  different  Individuals  using  different  procedures  and 
criteria.  Hie  study  in  this  thesis  spanned  science,  engineering,  economics, 
business,  social  science,  public  affairs  and  the  humanities.  It  was  per¬ 
formed  exclusively  by  the  author,  thus  eliminating  inter  operator  error  and, 
in  the  author' 8  estimation,  lending  additional  support  to  its  results. 


VII.  FUTURE 


In  the  future,  new  applications  of  KWIC  indexing  will  appear  with 
great  frequency  nov  that  the  advantages  of  this  system  have  been  demonstrated. 
If  the  information  to  be  indexed  can  be  described  in  roman  letters,  it  can 
be  handled  by  a  computer  by  using  a  keyword-in-context  program.  As  KWIC 
indexes  become  available  in  more  and  more  areas  of  knowledge,  it  is  possible 
that  authors  will  bear  in  mind  to  an  even  greater  extent  the  later  retrie- 
vability  of  their  papers  when  writing  the  title.  At  Bell  Telephone  Labor¬ 
atories,  to  encourage  further  improvement  in  titling,  its  Technical  Infor¬ 
mation  Libraries  recently  prepared  and  distributed  to  more  than  5000  of 

the  Laboratories'  scientific  and  engineering  personnel  a  concise  guide  on 

(76) 

choosing  titles  for  their  papers. 

V.  W.  Youden,  data  processing  expert  of  the  National  Bureau  of 
Standards,  sees  a  bright  future  for  computer-produced  Indexes.  Hie  author 
includes  Mr.  Youden* s  comment  because  it  provides  the  desired  prophetic 
note  on  which  to  end  this  thesis.  Here  is  what  Mr.  Youden  has  to  say  on 
the  subject: 


"Hie  use  of  computers  in  the  production  of  indexes  will 
increase.  By  feeding  the  output  of  the  computer  into  a 
photo  composition  machine  there  will  be  an  improvement  in 
both  the  quality  of  the  printing  and  the  size  of  the  char¬ 
acter  set.  Today,  the  entire  cost  of  a  computer  run  to 
produce  one  copy  of  an  index  should  be  less  than  the  cost 
of  keystroking  the  input.  Hie  facility  with  which  indexes 
may  be  updated  and  the  ease  of  selecting  items  for  special 
bibliographies  will  result  in  the  majority  of  indexes  being 
computer  produced  before  many  years.  As  more  and  more  key¬ 
word  indexes  are  published  the  author's  choice  of  title 
words  will  improve,  which  will  lead  to  more  and  better  key¬ 
word  indexes.  Because  of  the  Intellectual  labor  involved 


It  is  unlikely  that  even  with  computers  the  amount  of  sub¬ 
ject-indexing  will  increase  greatly. 

. . .The  day  can  not  be  too  far  off  when  printed  indexes 
to  scientific  and  technical  libraries  will  be  available 
to  the  individual  researcher  at  his  desk  at  a  reasonable 
cost."  (77) 
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APPENDIX  A 

Lockheed  Aircraft  Corporation  Materials 
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APPENDIX  A 


This  appendix  offers  four  examples  of  computer-produced  outputs 
from  the  newly  Installed  mechanized  Information  service  system  at  the 
Lockheed  Aircraft  Corporation,  Marietta,  Georgia.  The  outputs  are: 

(a)  an  accession  list  announcing  all  information  material  received,  pre¬ 
pared  on  Multllith  stencils  for  large  reproduction  (see  Figure  12);  (b) 
a  cumulative  index  of  report  numbers  in  lieu  of  a  conventional  card  file, 
with  a  carbon  copy  for  each  information  center  within  company  (see 
Figure  13);  (c)  a  mechanically  prepared  subject  index  (for  each  infor¬ 
mation  center  through  carbon  copy  print-out  process)  in  lieu  of  con¬ 
ventional  card  file,  using  a  "Keyword- In-Context"  title  system  (see 
Figure  lU);  and  (d)  a  cumulative  personal  author  index  for  books  and  re¬ 
ports  in  lieu  of  a  conventional  card  file  with  a  carbon  copy  for  each  in¬ 
formation  center  (see  Figure  15). 
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